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THE ETA INVARIANT AND EQUIVARIANT INDEX OF 
TRANSVERSALLY ELLIPTIC OPERATORS 

JOCHEN BRUNING, FRANZ W. KAMBER, AND KEN RICHARDSON 

Abstract. We prove a formula for the multiplicities of the index of an equivariant transver- 
sally elliptic operator on a G-manifold. The formula is a sum of integrals over blowups of 
the strata of the group action and also involves eta invariants of associated elliptic oper- 
ators. Among the applications, we obtain an index formula for basic Dirac operators on 
Riemannian foliations, a problem that was open for many years. 
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1. Introduction 

Suppose that a compact Lie group G acts by isometrics on a compact, connected Rie- 
mannian manifold M, and let E = E^ © E~ be a graded, G-equivariant Hermitian vector 
bundle over M. We consider a first order G-equivariant differential operator D = D^ : 
r{M,E^) —7- r{M,E~) that is transversally elliptic, and let D^ be the formal adjoint of 
D+. 

The group G acts on T{M,E'^) by (gs) (x) = g ■ s{g~^x), and the (possibly infinite- 
dimensional) subspaces ker {D~^) and ker {D~) are G- invariant subspaces. Let p : G ^ U [Vp) 
be an irreducible unitary representation of G, and let xp = tr (p) denote its character. 
Let T {MjE'^Y be the subspace of sections that is the direct sum of the irreducible G- 
representation subspaces of F (M, E^) that are unitarily equivalent to the representation p. 
It can be shown that the extended operators 

Dp^s ■■ H' (F {M,E+y) -^ H'-' (F {M,E~y) 

are Fredholm and independent of s, so that each irreducible representation of G appears 
with finite multiplicity in ker D^*" (see Corollary 13.31) . Let a^ G Z>o be the multiplicity of p 
in ker (-D^). 

The study of index theory for such transversally elliptic operators was initiated by M. 
Atiyah and I. Singer in the early 1970s ([2j). The virtual representation- valued index of D 
is given by 

ind^(D):=5^(a;-a;)[p], 
p 
where [p] denotes the equivalence class of the irreducible representation p. The index mul- 
tiplicity is 

ind'' (D) := a+-a- = ^r— ^ind (^lr(M,£+)''-.r{M,£-)'') • 

In particular, if po is the trivial representation of G, then 



ind"" {D) = ind (^lr(M,E+)«^r(Af,s-)« 
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where the superscript G imphes restriction to G-invariant sections. 

There is a clear relationship between the index multiplicities and Atiyah's equivariant 
distribution- valued index indg (D); the multiplicities determine the distributional index, and 
vice versa. Let {Xi, ..., Xr} be an orthonormal basis of the Lie algebra of G. Let Cxj denote 
the induced Lie derivative with respect to Xj on sections of E, and let C = ^ ■ C*x.Cxj be the 
Casimir operator on sections of E. The space F (M, E'^Y is a subspace of the Ap-eigenspace 
of C. The virtual character ind^ (D) is given by (see [2]) 

ind,(D) : ="tr(<7|,,,^+)-tr(^|,^^^_)" 

= ^ind''(Z})xp(^). 
p 

Note that the sum above does not in general converge, since kei D~^ and kei D~ are in 
general infinite-dimensional, but it does make sense as a distribution on G. That is, if dg is 
the normalized, biinvariant Haar measure on G, and if = /3 -|- ^ CpXp ^ C*°° (G), with /3 
orthogonal to the subspace of class functions on G, then 

ind, (D)(0) = " f (Pig) indg (D) dg'^ 
Jg 

= Y, ind" (D) 1 {g) ^[M) d9 = Y. i^^" (^) 
p •' p 

an expression which converges because Cp is rapidly decreasing and ind^ {D) grows at most 
polynomially as p varies over the irreducible representations of G. From this calculation, we 
see that the multiplicities determine Atiyah's distributional index. Conversely, let a : G — > 
U {Va) be an irreducible unitary representation. Then 

ind, {D) {xa) = J^ind^ {D) f Xa {g)xMdg = md"D, 
p '' 

so that in principle complete knowledge of the equivariant distributional index is equivalent 
to knowing all of the multiplicities m.d^ {D). Because the operator D\j.,jy,j ^+y^^^j^j ^^y is 

Fredholm, all of the indices ind [D) , indg(D), and ind'' (Z)) depend only on the stable 
homotopy class of the principal transverse symbol of D. 

Let us now consider the heat kernel expression for the index multiplicities. The usual 
McKean-Singer argument shows that, in particular, for every t > 0, the index ind'' {D) may 
be expressed as the following iterated integral: 



^pi 



iYi(l''{D)= I I sir g-K{t,g ^x,x) Xpio) dg \dx\ 

= / {^r g ■ K+ {t,g''^x,x) -ti g ■ R- {t,g''^x,x)) Xpi.9) dg \dx\ (1.1) 

where K^ (t, -, ■) ^ F (M x M, E^ M (E^)*) is the kernel for e-*(^^^^+^-^^) on F (M, E^), 
letting \dx\ denote the Riemannian density over M. 

A priori, the integral above is singular near sets of the form 

y X X G.^ C M X G, 

G^&[H] 
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where the isotropy subgroup G^ is the subgroup of G that fixes x G M, and [H] is a conjugacy 
class of isotropy subgroups. 

A large body of work over the last twenty years has yielded theorems that express indg {D) 
and jj^j (tr g ■ K^ (t, g~^x, x) — ti g ■ K~ (t, g~^x, x)) \dx\ in terms of topological and geo- 
metric quantities, as in the Atiyah-Segal-Singer index theorem for elliptic operators [B] or 
the Berline-Vergne Theorem for transversally elliptic operators [ID],!!!]- However, until now 
there has been very little known about the problem of expressing ind'' (D) in terms of topo- 
logical or geometric quantities which are determined at the different strata of the G-manifold 
M. The special case when all of the isotropy groups are the same dimension was solved by 
M. Atiyah in [2j, and this result was utilized by T. Kawasaki to prove the Orbifold Index 
Theorem (see [33]). Our analysis is new in that the integral over the group in (11. II) is 
performed first, before integration over the manifold, and thus the invariants in our index 
theorem are very different from those seen in other equivariant index formulas. Theorem 19.21 
gives a formula for the Fourier coefficients of the virtual character instead of the value of the 
character at a particular g E G. 

Our main theorem (Theorem l9.2p expresses ind'' {D) as a sum of integrals over the different 
strata of the action of G on M, and it involves the eta invariant of associated equivariant 
elliptic operators on spheres normal to the strata. The result is 

ind^(D) = / _A'o{x) \dx\ +y]/3(S,J , 

Jg\Mo j^^ 

^ (s.) - ^ E ^:;^. (-" i^") + " (^rl) i^^ ^. (-) wa . 

(The notation will be explained later; the integrands Aq{x) and A^^(x) are the familar 
Atiyah-Singer integrands corresponding to local heat kernel supertraces of induced elliptic 
operators over closed manifolds.) Even in the case when the operator D is elliptic, this result 
was not known previously. Further, the formula above gives a method for computing eta 
invariants of Dirac-type operators on quotients of spheres by compact group actions; these 
have been computed previously only in some special cases. We emphasize that every part 
of the formula is explicitly computable from local information provided by the operator and 
manifold. Even the eta invariant of the operator D- ' on a sphere is calculated directly 
from the principal symbol of the operator D at one point of a singular stratum. The de 
Rham operator provides an important example illustrating the computability of the formula, 
yielding a new theorem expressing the equivariant Euler characteristic in terms of ordinary 
Euler characteristics of the strata of the group action (Theorem 110. ip . 

One of the primary motivations for obtaining an explicit formula for ind'' (D) was to use it 
to produce a basic index theorem for Riemannian foliations, thereby solving a problem that 
has been open since the 1980s (it is mentioned, for example, in [I9]). In fact, the basic index 
theorem is a consequence of the invariant index theorem (Theorem 19. 6p . corresponding to the 
trivial representation po- This theorem is stated in Section [10.41 We note that a recent paper 
of Gorokhovsky and Lott addresses this transverse index question on Riemannian foliations. 
Using a different technique, they are able to prove a formula for the basic index of a basic 
Dirac operator that is distinct from our formula, in the case where all the infinitesimal 
holonomy groups of the foliation are connected tori and if Molino's commuting sheaf is 
abelian and has trivial holonomy (see [23]). Our result requires at most mild topological 
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assumptions on the transverse structure of the strata of the Riemannian fohation and has a 
similar form to the formula above for ind'''' (D). In particular, the analogue for the Gauss- 
Bonnet Theorem for Riemannian foliations (Theorem 110.71) is a corollary and requires no 
assumptions on the structure of the Riemannian foliation. 

There are several new techniques in this paper that have not been explored previously. 
First, the fact that ind'' (D) is invariant under G-equivariant homotopies is used in a very 
specific way, and we keep track of the effects of these homotopies so that the formula for the 
index reflects data coming from the original operator and manifold. In Section [7] we describe 
a process of blowing up, cutting, and reassembling the G-manifold into what is called the 
desingularization, which also involves modifying the operator and vector bundles near the 
singular strata as well. The result is a G-manifold that has less intricate structure and for 
which the heat kernels are easier to evaluate. The key idea is to relate the local asymptotics 
of the equivariant heat kernel of the original manifold to the desingularized manifold; at 
this stage the eta invariant appears through a direct calculation on the normal bundle to 
the singular stratum. We note that our desingularization process and the equivariant index 
theorem were stated and announced in [52] and ^3]; recently Albin and Melrose have taken 
it a step further in tracking the effects of the desingularization on equivariant cohomology 
and equivariant K-theory ([!]). 

Another new idea in this paper is the decomposition of equivariant vector bundles over 
G-manifolds with one orbit type. A crucial step in the proof required the construction of a 
subbundle of an equivariant bundle over a G-invariant part of a stratum that is the minimal 
G-bundle decomposition that consists of direct sums of isotypical components of the bundle. 
We call this decomposition the fine decomposition and define it in Section 14.41 A more 
detailed account of this method will appear in [25] . 

There are certain assumptions on the operator D that are required to produce the formula 
in the main theorem, mainly that it has product-like structure near the singular strata after 
a G-equi variant homotopy. We note that most of the major examples of transversally elliptic 
differential operators have the required properties. In fact, in [40j, a large variety of examples 
of naturally defined transversal operators similar to Dirac operators are explored and shown 
under most conditions to provide all possible index classes of equivariant transversally elliptic 
operators. These operators almost always satisfy the required product condition at the 
singular strata (see Section [7.41) . Further, we note that when the basic index problem for 
transverse Dirac-type operators on Riemannian foliations is converted to an invariant index 
problem, the resulting operator on the G-manifold again satisfies the required assumptions, 
under mild topological conditions on the bundle and principal transverse symbol of the 
operator. 

The outline of the paper is as follows. We first review the stratification of G-manifolds 
in Section [2] and establish the elementary properties of transversally elliptic operators in 
Section [31 In Section Hj, we discuss equivariant analysis on manifolds with one orbit type and 
decompose equivariant bundles over them in various ways, including the fine decomposition 
mentioned above. The relevant properties of the supertrace of the equivariant heat kernel are 
discussed in Section [51 In Section 16.21 we compute the local contribution of the supertrace 
of a general constant coefficient equivariant heat operator in the neighborhood of a singular 
point of an orthogonal group action on a sphere. It is here that the equivariant index is 
related to a boundary value problem, which explains the presence of eta invariants in the 
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main theorem. In Section [TJ we describe the iterative process of desingularizing the G- 
manifold near a minimal stratum and producing a double of the manifold with one less 
stratum. We apply the heat kernel analysis, representation theory, and fine decomposition 
to produce a heat kernel splitting formula in Section |H1 This process leads to a reduction 
theorem for the equivariant heat supertrace (Theorem 19. II) . The main theorem follows and is 
stated in Section l9T2l Several examples are discussed in Section [TOl these examples show that 
all of the terms in the formula above are nontrivial. The basic index theorem for Riemannian 
foliations is stated and discussed in Section 110.41 

We note that other researchers have investigated transverse index theory of group actions 
and foliations in noncommutative geometry and topology; these papers answer different 
questions about the analysis and topology of certain groupoids (see [IT]). A survey of index 
theory, primarily in the noncommutative geometry setting, can be found in |34j . 

We thank James Glazebrook, Efton Park and Igor Prokhorenkov for helpful discussions. 
The authors would like to thank variously the Mathematisches Forschungsinstitut Ober- 
wolfach, the Erwin Schrodinger International Institute for Mathematical Physics (ESI), Vi- 
enna, the Department for Mathematical Sciences (IMF) at Aarhus University, the Centre de 
Recerca Matematica (CRM), Barcelona, and the Department of Mathematics at TCU for 
hospitality and support during the preparation of this work. 



2. Stratifications of G-manifolds 

In the following, we will describe some standard results from the theory of Lie group 
actions (see [13], [31]). Such G- manifolds are stratified spaces, and the stratification can 
be described explicitly. In the following discussion, G is a compact Lie group acting on a 
smooth, connected, closed manifold M. We assume that the action is effective, meaning that 
no g E G fixes all of M. (Otherwise, replace G with G/ {g E G : gx = x for all x G M}.) 
Choose a Riemannian metric for which G acts by isometrics; average the pullbacks of any 
fixed Riemannian metric over the group of diffeomorphisms to obtain such a metric. 

Given such an action and x G M, the isotropy or stabihzer subgroup Gx < G is defined 
to be {g E G : gx = x}. The orbit Ox of a point x is defined to be {gx : g G G}. Since 
Gxg = gGxg^^, the conjugacy class of the isotropy subgroup of a point is fixed along an 
orbit. 

On any such G-manifold, the conjugacy class of the isotropy subgroups along an orbit is 
called the orbit type. On any such G-manifold, there are a finite number of orbit types, 
and there is a partial order on the set of orbit types. Given subgroups H and K of G, we say 
that [H] < [K] if H is conjugate to a subgroup of K, and we say [H] < [K] if [H] < [K] and 
[H] 7^ [K]. We may enumerate the conjugacy classes of isotropy subgroups as [Go] , ..., [Gr] 
such that [Gi] < [Gj] implies that i < j. It is well-known that the union of the principal 
orbits (those with type [Go]) form an open dense subset Mo of the manifold M, and the 
other orbits are called singular. As a consequence, every isotropy subgroup H satisfies 
[Go] < [H]. Let Mj denote the set of points of M of orbit type [Gj] for each j; the set M,- 
is called the stratum corresponding to [Gj]. If [Gj] < [G^], it follows that the closure of 
Mj contains the closure of M^. A stratum Mj is called a minimal stratum if there does 
not exist a stratum M^ such that [Gj] < [G^] (equivalently, such that M^ C Mj). It is 
known that each stratum is a G-invariant submanifold of M, and in fact a minimal stratum 
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is a closed (but not necessarily connected) submanifold. Also, for each j, the submanifold 
^>j '■~ U ^k is a closed, G-invariant submanifold. 

[Gk]>[Gj] 

Now, given a proper, G- invariant submanifold 5* of M and e > 0, let T^{S) denote the 
union of the images of the exponential map at s for s G 5* restricted to the open ball of 
radius e in the normal bundle at S. It follows that T^{S) is also G -invariant. If Mj is a 
stratum and e is sufficiently small, then all orbits in T^ (Mj) \ Mj are of type [Gk], where 
[Gk] < [Gj]. This implies that ii j < k, M] nJh j^ 0, and Mk C Wj, then H^ and 14 
intersect at right angles, and their intersection consists of more singular strata (with isotropy 
groups containing conjugates of both Gk and Gj). 

Fix e > 0. We now decompose M as a disjoint union of sets Mq , . . . , M^. If there is 
only one isotropy type on M, then r = 0, and we let Mq = Eq = Mq = M. Otherwise, for 
j = r,r — 1, ..., 0, let Ej = 2%, and let 



^ = M,\[JMI (2.1) 

k>j 



M; = %^{M,)\[JMI, (2.2) 

k>j 



Thus, 



T, {^) C M;, E^^ C M,. 
The following facts about this decomposition are contained in [3L, pp. 203ff]: 
Lemma 2.1. For sufficiently small e > Q, we have, for every i G {0, . . . , r}.- 

r 

(1) M = I I Mf (disjoint union). 

i=0 

(2) Mf zs a union of G- orbits; S? zs a union of G- orbits. 

(3) r/ie manifold Mf is difjeomorphic to the interior of a compact G -manifold with 
corners; the orbit space Mf/G is a smooth manifold that is isometric to the interior 
of a triangulable, compact manifold with corners. The same is true for each Sf . 

(4) // [Gj] is the isotropy type of an orbit in Mf , then j < i and [Gj] < [Gi]. 

(5) The distance between the submanifold Mj and Mf forj > i is at least e. 

Remark 2.2. The lemma above remains true if at each stage T^ {Mj) is replaced by any 
sufficiently small open neighborhood of Mj that contains T^ {Mj), that is a union of G-orbits, 
and whose closure is a manifold with corners. 

Let 7 be a geodesic orthogonal to Mj through w G Mj. This situation occurs exactly 
when this geodesic is orthogonal both to the fixed point set M'^j of Gj and to the orbit C^ 
of G containing w. For any h G Gj, right multiplication by h maps geodesies orthogonal 
to M'^J through w to themselves and likewise maps geodesies orthogonal to O^ through w 
to themselves. Thus, the group Gj acts orthogonally on the normal space to w G Mj by 
the differential of the left action. Observe in addition that there are no fixed points for 
this action; that is, there is no element of the normal space that is fixed by every h E Gj. 
Since Gj acts without fixed points, the codimension of Mj is at least two if Gj preserves 
orientation. 
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3. Properties of transversally elliptic operators 

Let G be a compact Lie group, M be a compact, Riemannian G-manifold, and E ^ M 
a G-equivariant Hermitian vector bundle. For the following constructions, we refer to [14j. 
The unitary G-representation on L^ (M, E) admits an orthogonal Hilbert sum decomposition 
with respect to equivalence classes [p] of irreducible representations p : G ^ U (Vp): 

L" (M, E) = L^ (M, E)^ ®c Vp . (3.1) 

[p]eG 
The component L^ (M, E) of type [p] is given by 

L" (M, E)^ = Home [Vp, L^ (M, E)) = L^ (M, E ®c V;f 
and (13. ip is determined up to unitary equivalence by the inclusions (evaluation maps) 

tp : L' (M, E)^ ®c Vp -^ L^ (M, E) . (3.2) 

We define L^ (M, Ef C L^ (M, E) to be the image ip (tJ^ (M, E)^ ®c V^ and V (M, E)^ = 

F (M, E) n L^ (M, Ef. 

The orthogonal projections 

Pp : L^ (M, E) -> L^ (M, E)'' 

are given by integration over G: 

L" (M, E) %' L" (M, E) ®c Endc (V^p) = L" (M, E ®c V;*) ®c V^p 

^«T L^ (M, E ®c V;)'' ®c V-p ^ ^' (M, E)'' 

Lemma 3.1. Let p he an irreducible unitary representation of a compact Lie group G on a 
complex vector space Vp. Let Xp (") = tr p(-) he the character of p, and let a : G -^ U {Q) 
he any other representation on a Hermitian vector space Q. Let dh denote the volume form 
induced hy the hiinvariant, normalized metric on G. Let P° : Q ^ Qf denote the projection 
onto the the suhspace of Q on which the restriction of a is of type p. Then the following 
equation of endomorphisms of Q holds: 



Proof. If F is a class function on G, then for any element g E G, 

a{g) F (h) a{h) dh = F (h) a (g) a (h) dh 
Jg Jg 



/ F (h) a [ghg ^) dh a (g) , and letting h = ghg ^ 
Jg 

/ F f g^^hg ) a ih) dh a (g) since dh is biinvariant 
F(h)a Ch) dha{g)= F (h) a (h) dh a (g) , 



so J„ F (h) a {h) dh commutes with a {g) for all g E H. One can see easily that this remains 
true if we restrict the endomorphisms to an irreducible component Q^ of type f3. Schur's 



THE EQUIVARIANT INDEX 9 

Lemma implies that on this component J„ F [h) a {h) dh is a constant multiple of the identity 
I p. We evaluate the constant by taking traces. In particular, on this component, 

/ Xp{h) OL (h) dh = X^ih) j3 (h) dh = clfs implies 
Jg Jg 

/ X^ {h) Xa {h) dh = c dim Vp , so 
Jg 



otherwise 



D 



Given a group representation 9 : G ^ U (Ve) and an irreducible representation p : G ^ 
U (Vr) of the compact Lie group G, the multiplicity space of p in 6* is 

RomG{Vp,Ve), 

and the multiplicity of p in 6* is 

dimHomG(Vp, Ve). 

Given a subgroup H of G, and a representation a : H ^ U {W„), we may form the homoge- 
neous vector bundle G Xh W^ — )■ G/H . The space 

Ind (a) = L^ {G/H, GxhW„) 

of sections is a representation space for G, called the representation of G induced by a, or 
simply the induced representation. By the Frobenius reciprocity theorem, Ind is the right 
adjoint functor to Res, the restriction functor. That is, given a representation r : G — )• 
U {Vr), VResir) IS the representation space K with if-representation Res (r) = t\jj, and the 
multiplicity space of r in Ind (cr) satisfies 

Home (K, Ind (a)) = L^G/H,{G XhW^) ^cV:f 

for every representation a : H ^ U {Wa). This follows from the fact that a section s of the 
homogeneous vector bundle G Xh W^ is given by an if-equivariant function fg'.G^ W„, 
and fs is a G-invariant section if and only if fg is a constant in W^ . 

Let D be a G-equivariant, symmetric differential operator of order A; on F {M,E), which 
is transversally elliptic with respect to the G-action (see [2]). This means that the principal 
symbol a^ {D) (^) of D is invertible on all nonzero 

e G T^{M)^ = {^eT:{M) |eW = 

for every X tangent to the orbit at x.} 

Then D^ is a G-equi variant, symmetric differential operator of order 2k on F (M, E), which 
is transversally strongly elliptic. 

The following proposition is contained to some extent in [2] and [Ti] . 

Proposition 3.2. Let D be a G-equivariant, symmetric, transversally elliptic differential 
operator of order k on T (M, E) . 
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(1) The operators 

(and their powers) are essentially self-adjoint on L^ (M, E) and generate the self- 
adjoint operators D* = Sp . 

(2) The operator D (and its powers) is essentially self-adjoint on L^ (M, E) and generates 
a G-equivariant, self-adjoint operator TZ. With respect to the Hilbert sum decomposi- 
tion i\3. 1\) . the operator TZ decomposes as a sum 

[p]GG 

(3) Each component Sp has discrete spectrum without finite accumulation points and 
admits a complete system of smooth eigensections, and we have 

E, (7^)^ = E, (Sp) = E, (Dp) . 

(4) For each [p] G G, the eigenspaces of Sp Ip are finite G-modules of the form 

Ex (Sp ® Ip) = Ex (Sp) ®c Vp . 

Proof. D^ is completed to a strongly elliptic operator Dp by adding the k^^ power of an 
appropriate Casimir operator, restricting to Z)^ on L^ (M, E) = L"^ (M, E ®c Vp) ■ It 
follows that D'^p is essentially self-adjoint. Furthermore, {Dp + l\ is an isomorphism from 

the Sobolev space H'^'^ (M, E) to L^ (M, E). To see that the operators Dp are essentially self- 
adjoint and generate the self-adjoint operators Sp on L^ (M, E) . suppose that D*pU = ±l u, 
with u nonzero in the domain Dom {D*) . Then we have 

{DpS, u) = (s, D*u) = =F6 (s, u) 
for all s G r (M, E) . Therefore, 

(Djs, u) = {DpS, D;u) = Ti {DpS, u) = Ti {s, D^u) = - (s, u) . 
That is, 

(s, (pp + /) * n) = (s, {Dl + lYu) = {{Dl + I) s, u) = 0, 

a contradiction. 

Next, the family {Sp}^ -i^q of self-adjoint operators defines a G-equivariant, self-adjoint 
operator 

n=QSp®ip 

[p]eG 
on L^ (M, E) whose domain is given by 

Up G Dom {Sp) ®c Ip, 
E[p] (ll^pf + \\i.Sp®Ip)up\\^) < oo 



and satisfies PpDom (7^) = Dom {Sp) ® Ip C. Dom (7^). Thus 



TZu = 2^ {Sp ® Ip)up , u E Dom {TZ) , Up = PpU. 
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For s G r (M, E), u & Dom (7^), we have 

(s, TZu) = ^ {PpS, {Sp (g) Ip) Up) 
[p] 

[p] 
= ^{PpDs,Up) = ^{Ds,Up) = {Ds,u), 

[p] [p] 

and thus Dom (7^) C Dom (-D*). Since the operators Sp = D** = D* are the closures of the 
components Dp of D and Sp® Ip = D*^* ® Ip = {Dp ® Ip)**, it follows that 

D** = (^p ® IpT* = 5, ® Jp = 7^. 

[p] [p] 

Since TZ is self-adjoint, it follows that D is essentially self-adjoint with closure TZ. D 

Corollary 3.3. The operators Dp induce operators Dps 

Dp^s ■■ H' (r [M^E^Y) -^ w^ (r {M,E^y) 

that are Fredholm and independent of s. 

Corollary 3.4. D admits a complete system of smooth eigensections. Since the spectrum 
is given by Spec{D) = |Jr , Spec{Dp), it need not be discrete, and the eigenvalues may have 
infinite multiplicities. 

Note that the eigenvalue counting function of D^ (of order 2k) satisfies the asymptotic 
formula 

N{X):= 5^ dim Eap(Z^p) 

AP<A 

~ cA™/2^ (3.3) 

where m is the dimension of M/G (see [H], applied to the strongly elliptic operator D"^ -h 
C-Xp). 

4. The case of one isotropy type 

In this section we consider the equivariant index problem and representation theory in 
the case where the group action has one isotropy type. The interested reader may consult 
the paper [25] to obtain more detailed exposition and more explicit and extensive results on 
G-bundles over manifolds with one isotropy type. 

4.1. Induced bundles over the orbit space. The statements in this subsection are for 
the most part known (see, for example, [E]), but we will use them later in the paper. Let 
G be a compact Lie group, and let X be a (not necessarily closed) Riemannian G-manifold, 
and suppose that there is only one isotropy type. For all x G X, let Ox denote the orbit Gx. 
Let X denote the manifold G\X, and let tt : X — )■ X denote the projection. The metric g 
on X induces a metric ^ on X defined uniquely by 

'9^{x) i.'^*^^ ^*w) = (vol (Ox))^^ '^™(^'' giv,w) 
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for any x G X and v,w & N^ (Ox) C T^X. The scale factor is chosen so that vol X = vol X. 
Let E' be a Hermitian, G-equivariant vector bundle over X, and let p : G — t- f/ (V^) be an 
irreducible unitary representation. Denote by G^ the isotropy group at x G X. Define the 
vector spaces £p {O^) and £^ {O^) by 

Sp {Ox) : = L^ (Ox, E)^ = Home {V^, L' (O^, E)) 

^ EomG{V„L'{Ox,GxG^Ex)) 

= Home, {Vp, Ex) = [Ex ® V;f'' , 

£' {Ox) : = L" {Ox. EY = ip {Ep (tt (x)) ®c Vp) ■ 

Note that ip above is not necessarily one to one. Both Ep {Ox) and E'' {Ox) are well-defined 
vector spaces whose dimensions are constant, and moreover Ep{-) and E^ {■) form Hermitian 
vector bundles over X (see [El Lemma 1.2 ff]). In fact, the vector spaces Ep^x defined for 
each X G X by 

Ep^x = Home, {Vp, Ex) 

form a G-invariant subbundle Ep of Hom {Vp, E) over X. The Hermitian structure on E^ is 
defined uniquely by 

(SbS2)^(^) = (si(x),S2(x))^ 

for every x G X. With these choices, we have canonical isomorphisms 

r (X, Ep) ^ r (X, Ep)"" = r (x, e)^ , r (x, e') ^ r (x, e)' 

L'^{X,Ep) ^ L^{X,Ep)^ = L^{X,E)p, L^(X,Ep)^L^{X,EY . (4.1) 

If E has a grading, there are gradings induced on Ep and E^ in the obvious way. 

4.2. Equivariant operators on G-manifolds with one orbit type. Given a transver- 
sally elliptic, G-equivariant operator D on sections of E over X, the operator 

induces an operator, called V, on sections of E^ over X. Similarly, D induces an operator 
Vp on sections of Ep over X. Furthermore, V and Vp are elliptic operators. If D is essen- 
tially self-adjoint on X, then V^ and Vp are also essentially self-adjoint on L^ {^X,Ep) and 
L^ (^X,Ep). The supertrace of the equivariant heat kernel corresponding to D restricted to 
r (X, E)'^ can be identified with the supertrace of the (ordinary) heat kernel associated to 
the elliptic operator V^ on T (X,£^^) (similarly Vp on T (^X,Ep).) 
Thus, 

md''{D) = -^^md{VP) 
dim Vp 



ind {V^ 



P1 1 



which is the Atiyah-Singer index of the elliptic operator Vp on the base manifold X. This is 
also a special case of our main theorem (Theorem 19. 2p . 
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4.3. The normalized isotypical decomposition. We retain the notation of the previous 
subsections. For further detail regarding topics in this section, we refer the reader to [25j. 
Again, we emphasize that X has one isotropy type [H], so that the orbits form a Riemannian 
foliation of X. Let N = N (H); note that A^-bundles over the fixed point set X^ induce 
G-bundles over X and vice versa. 

Let E ^ X he a given G-equivariant vector bundle over X. For each x G X^ , let 
T,E^ = {[cr : H -^ U (Wo-)] irreducible : Roirh (Wo-, E^) 7^ 0} be the set of equivalence classes 
of irreducible representations of H present in E^] by rigidity, T^e^ is locally constant in x. 

Let E^; = IJ T^E^- The isotypical (or primary) decomposition of the if- module E^ is of 

xexH 
the form 

where 

EW=v(HomH(W^.,^.)®l^.). 

Note that the representations Ex are not necessarily irreducible. Further, these subspaces 
do not necessarily form iV-equivariant bundles as x varies over X^ C X. In particular, 
if the normalizer N is disconnected it may be the case that an element n & N maps a 
primary component E" to an inequivalent primary component of Enx, and nx G X^ . The 
representation of H on nEx C Enx is given by 

hv = n {n^^hn) {n^^v) , h E H,v E E^x 

so that the representation on nE" is equivalent to a direct sum of representations of type 
[a^:H^U {Wo J] defined by 

< (h) = (Tx (n-^hn) . (4.2) 

For this reason, we will instead use a more coarse decomposition of Ex- For each n E N, 
we see that Ex = n~^ [Enx ), an if-invariant subspace of Ex that is the primary [cr"]-part 

of the representation of H on Ex- The representation of H on Ex is equivalent to the 
representation of H on nEx C Enx- We say that the two representations ax and a" are 
normalizer-conjugate. It is often the case that a" is equivalent to a^; as explained in [25], 
the rigidity of irreducible representations implies that the set 

N[o] = {nEN:[a"] = [a]}, 

is a subgroup of A^ such that A^/A^[o-] is finite. Let ni,...,nfc G A^ be elements such that 
N/N[o] = {niN[o] ,...,nfciV[,]}. Let 

{Exf = ^Et^'^cEx. 
j=i 
Here, a is the set of equivalence classes of irreducible representations inside the set {a" : n G A^}, 
so that we see that the set of all [ExY in Ex is in fact indexed by the finite set of such a. 
We decompose for each x G X^ C X, 

Ex = @{Exr. 
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These subspaces {ExY are in fact invariant under the action oi n ^ N and patch together to 
form well-defined A^-equivariant subbundles of E\-^h ■ Thus, G acts on these subspaces to 
produce well-defined subbundles of E over each orbit, and these subbundles patch together 
to form well-defined G-subbundles E^,...,E^ over X. In summary, we may decompose the 
vector bundle E as 

E = 0E^ (4.3) 

j 

where each G-bundle E^ is the direct sum of primary components E'^ corresponding to 
irreducible representations a of the isotropy subgroup that are all normalizer-conjugate. 
Further, the representations present in E^ are not normalizer-conjugate to those present in 
]^k £qj, j _^ ^ -^g pg^jj ^]-^jg ^]-^g normalized isotypical decomposition; see [25] for details. 

Let A^ be the connected component of A^ relative to H, so that ttq {N /H) = N /N . If we 
denote by N^„^ the subgroup (of finite index) of A^ fixing [a] G S^;, so that A^ C A^j^j C A^ 

and E^"'^ is A^io-j-equivariant, we may rephrase the preceding construction by saying that the 
normalized isotypical components are obtained by 'inducing up' the isotypical components 
j^W] from N^„-^ to A^. That is, the normalized isotypical component over X^ induced from 
[a] G Sg is the set 

A^ X c^ eM 

This gives an A^-subbundle of E over X^ containing E^"''^ that induces the normalized iso- 
typical component over all of X. 

4.4. The refined isotypical decomposition. With notation as above, let X^ be the fixed 
point set of if, and for a G ttq (AT^) , let X^ denote the corresponding connected component 
ofX^. 

Definition 4.1. We denote X^ = GX^ , and Xa is called a component of X relative to 
G. 

Remark 4.2. The space Xa is not necessarily connected, but it is the inverse image of a 
connected component of G\X = N\X^ under the projection X — )■ G\X. Also, note that 
Xa = Xp if there exists n & N such that nX^ = X¥ . If X is a closed manifold, then there 
are a finite number of components of X relative to G. 

We now introduce a decomposition of a G-bundle E —^ X over a G-space with single orbit 
type [H] that is a priori finer than the normalized isotypical decomposition. Let E^ be the 
restriction E\-^h- As in the previous section, let A^[o-] = {n ^ N : [a"] is equivalent to [a] } 

. If the isotypical component Ea is nontrivial, then it is invariant under the subgroup 
^a,[ij] ^ -^[o-] that leaves in addition the connected component X^ invariant; again, this 
subgroup has finite index in N . The isotypical components transform under n G X as 

n : EH ^ E^f:\ , 

a n\a) ' 

where n denotes the residue class class of n G X in N/Na\a] ■ Then a decomposition of E 
is obtained by 'inducing up' the isotypical components Ea from Na,[a\ to N . That is. 
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. This is an A^-bundle over NX^ C X^ , and a similar bundle 



is a bundle containing Ea 

may be formed over each distinct NX^, with /3 G ttq {X^). Further, observe that since each 
bundle E^,-, is an A^-bundle over NX^ , it defines a unique G bundle E^ r , . 

Definition 4.3. The G-bundle E^,^ over the submanifold Xa is called a fine component 
or the fine component of E ^ X associated to (a, [a]). 

If G\X is not connected, one must construct the fine components separately over each Xa- 
If E has finite rank, then E may be decomposed as a direct sum of distinct fine components 
over each X^- In any case, E^,^ is a finite direct sum of isotypical components over each 
X^ 



a 



Definition 4.4. The direct sum decomposition of E\-^ into subbundles E^ that are fine 
components -E^r , for some [a], written 

b 

is called the refined isotypical decomposition (or fine decomposition) ol E\^ . 

In the case where G\X is connected, the group ttq {N /H) acts transitively on the con- 
nected components ttq {X^^ , and thus X^ = X. We comment that if [a, W^] is an irreducible 

if -representation present in E^ with x G X^ , then Ex is a subspace of a distinct E^ for 
some b. The subspace E^ also contains E'iT for every n such that nX^ = X^ . 

Remark 4.5. Observe that by construction, for x G X^ the multiplicity and dimension of 
each [a] present in a specific E^ is independent of [a]. Thus, Ex and Ex have the same 
multiplicity and dimension if nX^ = X^ . 

Remark 4.6. The advantage of this decomposition over the isotypical decomposition is that 
each E^ is a G-bundle defined over all of X^, and the isotypical decomposition may only be 
defined over X^. 

This new decomposition is a priori a finer decomposition than the normal isotypical de- 
composition into G-subbundles. 

Definition 4.7. Now, let E he a G-equivariant vector bundle over X, and let E^ be a 
fine component as in Definition 14.31 corresponding to a specific component X^ = GX^ of 
X relative to G. Suppose that another G-bundle W over Xa has finite rank and has the 
property that the equivalence classes of Gj^-representations present in Ey,y G Xa exactly 
coincide with the equivalence classes of Gj^-representations present in Wy, and that W has a 
single component in the fine decomposition. Then we say that W is adapted to E^. 

Lemma 4.8. In the definition above, if another G -bundle W over Xa has finite rank and has 
the property that the equivalence classes of Gy-representations present in Ey,y G Xq, exactly 
coincide with the equivalence classes of Gy-representations present in Wy, then it follows that 
W has a single component in the fine decomposition and hence is adapted to E^ . Thus, the 
last phrase in the corresponding sentence in the above definition is superfluous. 

Proof. Suppose that we choose an equivalence class [a] of if -representations present in Wx, 
X G X^ . Let [cr'] be any other equivalence class; then, by hypothesis, there exists n E N such 
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that nX^ = Xf and [a'] = [ct"]. Then, observe that nWt^ = wt"^ = wi""\ with the last 
equahty coming from the rigidity of irreducible if-representations. Thus, W is contained in a 
single fine component, and so it must have a single component in the fine decomposition. D 

4.5. Canonical isotropy G-bundles. In what follows, we show that there are naturally 
defined finite-dimensional vector bundles that are adapted to any fine components. Once and 
for all, we enumerate the irreducible representations { [pj, Vp~\ } .^^ ^ of ^- Let [a^ W^] be 
any irreducible if -representation. Let G Xh W„ be the corresponding homogeneous vector 
bundle over the homogeneous space G/H. Then the L^-sections of this vector bundle 
decompose into irreducible G- representations. In particular, let \_Pjo, Vp. ] be the equivalence 
class of irreducible representations that is present in L^ {G/H, G x^ W^) and that has the 
lowest index jo- Then Frobenius reciprocity implies 

^ Home (V^p,^, L2 {G/H, Gxh W^)) ^ Hom^ (v^Res(p,„)' ^-) > 

so that the restriction of p^^ to H contains the //-representation [a] . Now, for a component 
X^ of X^, with Xa = GX^ its component in X relative to G, the trivial bundle 

is a G-bundle (with diagonal action) that contains a nontrivial fine component W^o,[(t] con- 
tainingXf x(V^,^j''^l. 

Definition 4.9. We call Wa^ia] — ^ Xa the canonical isotropy G-bundle associated to 

(a, [a]) G ttq {X^) x H. Observe that Wa\a] depends only on the enumeration of irreducible 
representations of G, the irreducible //-representation [a] and the component X^ . We also 
denote the following positive integers associated to PVajo-]: 

• ^^a\a] = dimHomj:^ (VFo-, VFajo-j^a:) = dim Hom j:^ ( PFq- , V^pj ) (the associated multi- 
plicity), independent of the choice of [a, W^] present in W^ [a]x i x E X^ (see Remark 

USD. 

• da,[cr] = dimiycr(the associated representation dimension), independent of the 
choice of [a, W^] present in Wa,[a],x , x G X^ . 

• ^a M = '^ (the inequivalence number), the number of inequivalent repre- 

sentations present in Wq,[o-],x , x G X^ . 

Remark 4.10. Observe that VFq, [o-] = Wa' [a'] if [o"'] = [cr"] for some n E N such that 
nX^ = XS. 

The lemma below follows immediately from Lemma 14.81 

Lemma 4.11. Given any G-bundle E -^ X and any fine component E^ of E over some 
Xa = GX^ , there exists a canonical isotropy G-bundle Wq,[o-] adapted to E'^ — )■ X^- 

4.6. Decomposing sections in tensor products of equivariant bundles. We now con- 
sider a method of decomposing sections of a tensor product of equivariant bundles. Suppose 
that El ^ X is a (possibly infinite-dimensional) G-equivariant vector bundle over a manifold 

with one orbit type [//]. Let X^ = GXf C X, and let Ei,x, := ^i|x, = 0^i be the fine 

' " b 

decomposition (Definition 14. 4p . Let W'' = Wa^ia] — ;■ X^ be the canonical isotropy G-bundle 

adapted to E^, as in Definition 14.91 and Lemma 14.111 Every [cr] G // that is present in W^ 
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has associated multiplicity rrih , which is independent oi x E X^. Let W^ = 0Wj^a, be 

j 
the isotypical decomposition, so that each j refers to a distinct irreducible il/^-representation 

type [cbj], each with dimension mb ■ db, where db is the dimension of that irreducible rep- 
resentation. Let ii^2 — ^ -^ be another G-equivariant vector bundle over X. Restricted to a 
single orbit O^ = Gx in X^, let -^2,0^^ — -^slo • Then Frobenius reciprocity implies 

Home {V„ r (a, Ela^ ® E2,o.)) ® Hom^ {W^, W^) 

j 

^ Hom^ (\/Res(p), ^t ® ^2,x) ® Hom^ {W^,, W^,) 

j 

^ Homn (VRes(p), Hom^ (W^';,, i^i^,,) ® W^?, ® E2,.) , 
j 

Since Homj;/ {W^,^, ^i,x) i^ ^ trivial if-space, 

Home {V„ r (a, i^to. ® E,,o.)) ® Homn (W^^., W^) 

j 

^ Homn {Wl,, ^t) ® Hom^ (\/Res(p), W^, ® E2,,) 



Then 



r (a, Ei^,^^ ^2,0.)" ® Homn {W^, Wl) 

j 

Home {V,, r (a, Ei^,^^ ® E2,oJ) ® V; Homn (W^^., Wl^) 

j 

Homn (W^^,, El^) ® Hom^ (VRes(p), W^^- ® ^2,.) » V^ 
i 

Homn {Wl^, ^t) ® r (a, W;^ ® E2' 



where W^ — > (9^; is the bundle G Xh W^^ C W^\,^ with the identification x = eH. Observe 
that the isomorphism above is an isomorphism of G-modules, where G acts trivially on 
Homji^ {Wj,^,Wj,^) and on Hom^/ (Wj,j.,E[,^). Let L : Ei ^ Ei he a G-equivariant bundle 
map, and let -B : F (X, E2) — t- F (X, E2) be a G-equivariant operator. Let V' : E\ ^ E\ be 

the restriction. We note that L^ acts on E\^^ = 0Hom^ (W^j>>^m) ® ^j,x by L' ^ ® 1, 

j 
where L' ^ : Hom^/ {Wj,^, E^,^) — )■ Hom// (^j>' -^m) ^^^^ ^^ post-composing with L^. 
The following Lemma is a consequence of the derivation above and the slice theorem. 

Lemma 4.12. Let T^ -^ Ox be a tubular neighborhood of Ox C X such that T^ = G Xh D^, 
where x & Df, C. X^ is a ball transverse to Ox- Then the operator L® B ®1 corresponds to 



3 \De 



P 
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L' ^ ® {1 ® B)^ through the isomorphism 

j 

j 
with the isomorphism given by evaluation. If ® denotes the graded tensor product, then 

r (T„ El®E2Y ® HoniH lw^\^^ , IV/' 
j 

j 

In the above, W^ = W^ is the isotypical decomposition, 
j 



5. Properties of the Equivariant Heat Kernel and Equivariant Index 

5.1. The equivariant heat kernel and index. We now review some properties of the 
equivariant index and equivariant heat kernel that are known to experts in the field but are 
not written in the literature in the form and generality required in this paper (see [2], |14j . 
[T3] . [S]). With notation as in the introduction, let E = E^ ®E~ be a graded, G-equivariant 
vector bundle over M. We consider a first order G-equivariant differential operator D^ : 
r (M, E~^) — !■ r (M, E~) which is transversally elliptic, and let D~ be the formal adjoint of 
D^. The restriction D^''' = -D^|p(j^^^>,p behaves in a similar way to an elliptic operator. Let 
C : r (M, E') — > r (M, E) be the Casimir operator described in the introduction, and let Xp 
be the eigenvalue of C associated to the representation type [p\. The following argument can 
be seen in some form in Pj. Given a section a G F (M, E'^Y, we have 



D-D+a = {D-D+ + C-\p) 



a. 



Then D^D^ + C — Ap is self-adjoint and elliptic and has finite dimensional eigenspaces 
consisting of smooth sections. Thus, the eigenspaces of D^ D^ restricted to F (M, E^Y are 
finite dimensional and consist of smooth sections, and the index ind'' [D) is well-defined. 
Further, the [p]-part K^^^ of the heat kernel of e~*^ ^ is the same as the [p]-part of the heat 
kernel K (t, -, ■) of ^-t{D-D++c-x,) _ Let 

A < /32 < ... 

be the eigenvalues oi D^ D^ +C —Xp repeated according to multiplicities, which correspond to 
the L^ orthonormal set of eigensections {ai, 0^2, ...}. We may choose that basis so that each aj 

belongs to a specific irreducible representation space of G. The kernel K^ of e"**^ ^ ^ p) 

satisfies 

K+ {t, x,y) = J2 ^''^"^k {x) ® («fe {y)r G Hom (i?+, i?+) . 
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Observe that for all g E G, 

g-K+{t,g-'x,x) = J2e~'^'g ■ a^ (g-'x) (aUx))* 

k 

= E ^~'^' E ^ (9) {Pr,au) (x) ® {a, {x)r , 
k [n] 

where the interior sum is over all equivalence classes of irreducible unitary representations 
rj of G, and P^ is the projection onto the [77] -component. By the way we have chosen the 
basis {tti, 02, •••}, each P^a^ is either Uk or 0, so in fact {PrjCik) (x) ® (ofc (a;))* = (P^afc) (x) ® 
{Pr,Oik {x))* . Next, let p be a particular irreducible representation, and let xp be its character. 
By Lemma [3.11 if dg is the biinvariant, normalized Haar volume form. 



and 



ii {r]{g){Pr^ak){x)®{ak{x)y) Xpig) dg \dx\ 

x<aM J geG 



tr {r] (g) (P^ttfc) (x) ® {Pr,ak {x))*) Xp {d) dg \dx\ 

xeM J geG 

If ^ 1 

e^drip / tr {ak (x) ® ak (x)*) \dx\ = — — —elSnp, 



dimKp "^J^^M dim^p 

where e^ is 1 if ak is a section of type rj and otherwise, and where 5^p = 1 if r^ is equivalent 
to p and is zero otherwise. Using this information, we have that 



/ / tr {g ■ K+ {t,g 'x,x)) Xpig) dg \dx\ = ^t—ttYI 

Jx&M Jg&G Cll™ V ^ 



e-'^-ei 



n V ^-^ 



dim^p 



where /ct''' are the specific positive integers corresponding to eigensections akip] of type \p\. 
In summary. 



tr I e-*^^^" 



r(Af,£;+)V ^ 

k\p\ 



dimVp / tr {g-K+{t,g ^x,x)) Xp{g) dg \dx\ 

JxPM JnPG 



'x£M JgeG 

Similar arguments apply to the operator D^D^ . The usual McKean-Singer argument implies 
that the supertrace of the heat kernel K corresponding to D = i „_,_ „ J restricted to 
r (M, E^ © E^Y is the same as the index ind^ (D). By the argument above, 

mdP{D)= f f sti g-K{t,g-'x,x) Xp{g) dg \dx\, (5.1) 

Jx&M JgeG 

where K is the heat kernel of e"**^ '*'"''''. Since the heat kernel K changes smoothly with 
respect to G-equivariant deformations of the metric and of the operator D and the right hand 
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side is an integer, we see that ind'' [D) is stable under such homotopies of the operator D^ 
through G-equivariant transversally elhptic operators. This imphes that the indices ind (D) 
and indg (D) mentioned in the introduction depend only on the G-equivariant homotopy class 
of the principal transverse symbol of D^. (We knew this already because of the Fredholm 
properties discussed in Section O) 

Note also that e~*^ '^ ~ p) differs from e~*^ ^ '' by a factor of e'^''*, so we also have 
that 

ind^ (D) = lim / / sti g ■ K^ {t,g'^x,x) Xpi.9) dg \dx\ , 

where K'^ is the heat kernel of e~*^ ~^ ''. 

5.2. The asymptotic expansion of the supertrace of the equivariant heat kernel. 

We now use Lemma 12.11 to decompose M = |JI=o ^f ^^^° ^ disjoint union of pieces so that 
the integral ( 15. ip can be simplified. Also, observe that the kernel K and the metric on M 
are smooth functions of the operator D^ and the metric on M. As we have mentioned, 
the index ind'' {D) is invariant under smooth, G-equivariant perturbations of D'^ and the 
metric. In particular, on each Mf for i > (ie not including Mq, the union of the principal 
orbits), in normal directions to the singular stratum Mj, we may flatten the metric, trivialize 
the bundles E^, and make the operator D have constant coefficients with respect to the 
trivialized normal coordinates. Hence, 

ind'' {D) = J2 [ [ str {g ■ K (t, g-^w, w)) Xpig) dg \dw\ 

^ JweMf JgeG 

= y2 / ^^T^ [a- K {t,g'^{x,z^),{x,z^))) Xpig) dg \dz^\ \dx\i, (5.2) 

j J{x,z^)(iMf JgdG 

where we choose coordinates w = {x,Zx) for the point exp;^ (z^), where x G Mj, z^: G B^. = 
B2ie i^x (Mi)), and exp;^ is the normal exponential map. In the expression above, \dzx\ is 
the Euclidean density on N^ (Mi), and \dx\^ is the Riemannian density on Mj. We note that 
the outer integral is not a true product integral if Mi is not the lowest stratum, because 
for the most part x G Sf and z^ G B^^ = -82% (A^x (Sf)), but to include all of M^ , some 
X G Mi \ Sf and z^ away from the zero section may be needed; metrically, this is the integral 
over a cylinder of small radius whose ends are concave spherical (of larger radius) instead of 
fiat. Recall that K {t, g~^ {x, z^) , (x, z^)) is a map from E(^x,zx) = E^ to -Eg-i(^^^^) = Eg-i^. 

One important idea is that the asymptotics of K {t, g~^w, u;) as t — )■ are completely 
determined by the operator's local expression along the minimal geodesic connecting g~^w 
and w, if g~^w and w are sufficiently close together. If the distance between g~^w and w 
is bounded away from zero, there is a constant c > such that K {t,g~^w,w) = O (e"'^/*) 
as t — )■ 0. For these reasons, it is clear that the asymptotics of the supertrace ind'' {D) 
are locally determined over spaces of orbits in M, meaning that the contribution to the 
index is a sum of t°-asymptotics of integrals of Jjj J^stii^g ■ K {t,g~^w,w)) Xpid) dg \dw\ 
over a finite collection of saturated sets U <Z M that are unions of orbits that intersect 
a neighborhood of a point of M. In particular, the index ind'' {D) is the sum of the t° 
asymptotics of the integrals over Mf. However, the integral of the t*^ asymptotic coefficient 
of /^ str {g ■ K (t, g~^w, w)) Xp (g) dg over all of M is not the index, and the integral of the 
t° asymptotic coefficient of /j^^str {g ■ K (t,g~^w,w)) dvol^ over all of G is not the index. 
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Thus, the integrals over M and G may not be separated when computing the local index 
contributions. In particular, the singular strata may not be ignored. 

5.3. Heat kernel equivariance property. With notation as in the previous sections, the 
kernel K+ of e-K^^^^+^-^p) satisfies 

K+ (t, x,y) = Y, ^''^"Oik {x) ® {ak {y))* e Hom (^+, E+) , 

k 

with {oj G r (E^)} is an L^-orthogonal basis of eigensections of A = D^D^ + C — Xp 
corresponding to eigenvalues f3j > (counted with multiplicity). 

If g- denotes the action of (7 G G on sections of E, note that {g ■ u) (x) = g -u {g~^x). The 
G-equivariance implies 

g ■ (Aa,) = {A{g- a,)) , 

or 

(3j {g ■ aj) = A{g- aj) , 
so that {g ■ aj} is another L^-ortho normal basis of eigensections, and 

K+ {t, x,y) = Y^ e-^^'^g ■ Ok {g~^x) ® [g ■ au {g'^y)]* 

= ^ e-'^'^g ■ ak [g-^x) ® [ak [g'^y)]* ° g'^ ' 

= g-K+{t,g-'x,g-'y)og-^. eRom{Ey,E,). (5.3) 

Note that Hom {E, E) is a G-bundle, and it carries the left G-action defined on L^ G 

Hom {E,, E,) = E^® El by 



g»L^ = g ■ L^og ^- g Hom {Eg^, Eg 
g • {v ® w*) = {g ■ v) 1^ (w* o g^^-) . 



■/gx) 1 

or 



With this action, 

g • {K+ [t, g-'x, g-'x)) = K+ (t, x, x) . 

Note g ■ K^ (t, g~^x, x) G Hom {E^, E,j). Observe that if we let Lg^^ = g ■ K^ (t, g~^x, x) G 
Hom {E^, E^), then 

g'^Lg^g"^, = g'-{g-K+{t,g-'{g'-'x),g'-'x))og'-' 

= g'-g- g'-'K+ (t, g'g-' (g'-'x) , g'g'-'x) o g' o g'-' 

by (O, or 

g' • ^3,3'-ix = {g'gg'^^) ■ K^ (t, {g'gg'^^) ^ x,xj = Lg,ggi-i^^ . 

This implies that 

K^ {t,x,xY = dimV g -K^ {t,g'^x,x) Xp{g) dg 

Jg 

= dim V^ j {g'gg'-') ■ K+ (t, {g'gg'-') "' x, x) ^^i^i^ dg, 
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by changing variables from g to g'gg'^^ for some fixed g' G G. By the formula above, we 
obtain 



K+{t,x,xr = idimV^g'- g-K+{t,g-^g'-'x),g'-'x) Xpig)dgog'-^ 

Jg 

= g ■ K^ [t,g x,g X) og . 

Equivalently, as sections of Hom {E, E), for all g & G, 

K^ (t, gx, gxY = g • K'^ (t, x, xY = g ■ K^ (t, x, xY o g^^. 

Furthermore, since the calculations above certainly apply to K^ , 

tiK^ {t, gx, gxY = tiK^ {t,x,xY , 

strK {t,gx,gxY = strK {t,x,x)'' . (5-4) 

Thus, these traces descend to functions on the orbit space. In order to evaluate the integral 
of K^ {t,x,x)^ over a neighborhood of a singular stratum S, it is sufficient to evaluate it 
over the normal bundle to S restricted to local sections of S — )■ G\'E. 

Note that the calculations above may be applied to nonelliptic kernels. In particular, we 
may let D be a fiberwise equivariant elliptic operator; then the calculations above apply to 
it. 

6. The Equivariant Index of an operator on a sphere 

The purpose of this section is to do an explicit calculation of local heat trace asymptotics 
of a very specific type of operator; this analysis will apply to a much more general situation 
later in the paper. We will relate the local equivariant supertrace of a heat operator on 
Euclidean space to that of the natural pullback of the operator to the radial blowup of the 
origin. In what follows, we will make very explicit choices in order to do the calculation, but 
the final result will be independent of those choices. 

6.1. Polar coordinate form of constant coefficient operator on R'^. In this section, 
we consider the following situation. Let Q : G°° (R.'^, C^) — )■ G°° (R.'^, C^) be an elliptic, first 
order, constant coefficient differential operator, where k >2. Let 

k 

where by assumption Aj G GL{d,C), and for any c = (ci,...,Cfc) G M'^, det(^CjAj) = 
implies c = 0. Note that 

k 

We form the symmetric operator Q : C°° {R^, C^ © C^) -^ C°^ (M^, C^ © C^) 
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We write Q in polar coordinates (r, 6) G (0, oo) x S^^^, with x = rO = r {6i, ..., 6k), as in 
Section [m 

Qi = Z+ (9, + -g^+ J , so that 

The purpose of this section is to prove the formula 

where a^ = stiKq (t, x, x) is the supertrace of the equivariant heat kernel of Q^ restricted to 
sections of type (3 (/3 being an irreducible representation of a group that commutes with Q), 
and where B^ (0) is the ball of radius e around the origin of M'^, and where a^ and B^ (^d^DS'^) 
correspond to the same neighborhood after a radial blowup of the origin confined to a smaller 
ball. 

In what follows, we will require another result. Assume Z = —Z*, and Q^ = Q^* on the 
sphere, so that Q^Z + ZQ^ = [k — 1) Z. (We note that the second assumption is satisfied 
automatically; see Section [Il.2[ ) Suppose that g is a smooth, positive, real- valued function 
on a subinterval / of (0, 00), and let Q : C°° (/ x S''-\ C^) -> C°° (/ x S''-\ C^) be defined 
by 

Q = z(dr + ^Q^ 

V lir) 

Let 

ds^ = [g {r)f de^ + dr^ 

be the metric on J x S''^^, where g is a. smooth positive function. The formal adjoint of dr 
with respect to this metric is then 

{k - 1) g' (r) 



di = -a - 



9{r) 



so that 



g{r) q{r) J 

^ {k-l)g'{r) 1 ^s ^-1 

g[r) q[r) q[r) 

\k-l)g'{r) k-l 



Q + 



g{r) q{r) _ 



(6.1) 



6.2. An induced operator on a sphere. We now consider a new operator induced from 
the operator in Section 16.11 as a symmetric operator on C^ © C^- valued functions on S^ C 
]^fc+i. jj^ particular, the metric and operator will be chosen to agree exactly with the original 
operator near the south pole. Suppose that H < O (k) acts on M.^~^^ in the first k coordinates 
and isometrically on the fibers C^and commutes with Q defined in 011.21) . Thus H represents 
on each copy of C^ as a unitary representation. Further, every element of H commutes 
with Z and with Q^. Using these operators, we will define a new operator on a rank 2d 
bundle E = E^ © E~ over S^ C M'^"'"^ to obtain an if-equivariant elliptic operator on 
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r (^S'',E^ © -E^) . In spherical coordinates (0,6*) G [0,7r] x S''^^, with corresponding to 
the (spherical) distance from the south pole Xk+i = —1, the operator we consider is defined 
on the lower hemisphere S'^'^ to be 



Z^ {d, + jI^Q^^^) 

mapping C°° (^S^'^, C^ © C^) to itself, where / (0) is a function that is smooth and positive 
on (0, tt) and such that / (0) =0 for near zero and / (0) = 1 near = |, so that the 
operator exactly agrees with the Euclidean operator Q near the south pole and is a cylindrical 
operator near the equator. We choose the manifold metric ds"^ = [g (0)] dd"^ + (i0^ near the 
south pole and equator to agree with the standard Euclidean metric and cylindrical metric, 
so that g (0) = for near zero and g (0) = 1 for near ^. By Equation f l6.ip . 

Again, we must choose the bundle metric so that Z is a unitary transformation, so in fact 
Z~^ and Z~ = (Z^)* are unitary as maps from C'' to itself. We now use the approach used 
in the index theory for manifolds with boundary to double the operator (see, for example, 
[12]). On the upper hemisphere, we use the same coordinates as on the refiection in the 
lower hemisphere so that the orientation is reversed, and we identify the opposite parts of 
the bundle C'^©C'^ via the map Z over the cylinder. The operator Q has the same description 
in the upper hemisphere as in the lower hemisphere. That is, let {6s, (ps) be the coordinates 
in the lower hemisphere, and let (6'„, 0„) be coordinates in the upper hemisphere. Near the 
equator, the transition function is 

On = ds] 4>n = 7r-0^. 

The bundles C'^©C'^ over the upper and lower hemispheres are identified as follows. A section 
{L^ {9s,(ps) ,L- {9s,4>s)) in the lower hemisphere is identified with the section 
(f/+ {9n, <t>n) , U- {On, 0n.)) in the upper hemisphere near the equator if 

Z+(^,)-^L_(^„0,) = t/+ (^„ TT - 0,) and 
Z-{esY'L+{esAs) = t/_(^„7r-0,),or 

Z+ {Os)-' \ f L+ {Os, 0s) \ /^ U+ {Os, 7T - 0,) 

{Os)-' J\L^ {Os, 0s) J \U^ {Os, vr - 0,) 

The bundle E~^ is defined to be C"' © {0} over the lower hemisphere and {0} © C"' (with 
identifications as above), and the bundle E~ is defined similarly. The operator Q can be 
extended to be well-defined on entire sphere, as follows. Define it as before on the two 
hemispheres, and so that near the equator 



Q 



L+ {Os, 0s) \ _ / {~d^^ + Q'+) Z-\(L 



L_ {Os, 0.) ; V ^"^ (^0. + Q'^) y V ^- ( 

(-9^„ + g^+) z-\(u+ 
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To check compatibility, we see that 

{-d^„ + Q'+)Z- \ f U+{9,An 

^+('90„ + g^+) j\u^{e,„(i)„ 

{d^^ + Q'+) Z- \ f {Z^)-'\fL, 

Z+ {-d^^ + Q^+) J\{Z-r' J\ L^ {Os, <Ps 

Z+{-d^^+Q^+){Z+)-^L^{Bs,c^s, 
We continue to simphfy to obtain 



v+ \ys,<4Js) 



(-9^„ + g^+) z- \ 
z+ (9^„ + g^+) ; 






{z+y^ \( 


) 


1 f L^iO^cf), 



Thus, the newly defined elliptic differential operator Q on F (S''^, -E^ © E~) is well-defined. 
This operator is self adjoint, and remains if-equivariant by construction. In fact Q has trivial 
kernel and thus zero index, and all possible equivariant indices are likewise zero. Note that 
the bundle E is no longer trivial. 

6.3. Local contribution of the heat supertrace near the south pole . 

6.3.1. Local elements of the kernel. We now wish to compute the local supertrace of the 
equivariant heat kernel associated to Q, in particular the part near the south pole. Let 
/3 : iJ — )■ GL (Vg) denote an irreducible representation of H. We know that the supertrace 
of e~^^ restricted to sections of type (3 is the index of Q'^ = QL/„i. „, „_\/3, which is zero; 

however, the local supertrace need not be trivial. Let u E T (^S^, E~^^ . Since H commutes 
with Q^ , F (^S'', E^^ is a direct sum of eigenspaces of Q^ . Near the south pole we write 

u (Os, 0s) = ^ux (0s) fx (Os) , 
A 

where Q^ h = Q^+ h = A/a. 

If M G Floe (5''^, E^) is a local smooth solution to the equation Q^u = near the south 
pole, then 

d4,,ux + —ux = 0, 

0s 

or 

Ux (0s) = Ca0;^ 

for some Cx G C Note that for A;>2, A<| — lif and only if 07'^ /a (^s) provides an element 
of the Sobolev space H^ that locally solves the differential equation (for k = 2, the condition 
is A < 0). Because kerQ is (globally) trivial, it is not possible to continue this solution to a 
global H^ solution of Qu = on the whole sphere. 
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On the other hand, if w G Fioc {S'', E^) is a local smooth solution to Q^u = 0, then 

Q''^^ = (d^. + ^Q'A Z-v 

(Ps (Ps J 

Z' f-9. + ^Q''] V = 



so that w = Z V E Fioc (5''^, -E^) satisfies 



-d^. - ^ + ^Q'^ ]w = 0. 



We write 

w{9s,(l)s) = ^wxi(l)s) f. 



A 

where as before Q^ fx = Q^^ f\ = A/a. 

Then Q^ {Z~Y ^ = near the south pole implies 

A;-l-A 
o<t>sW\ H 7 wx = 0, 

<Ps 

or 

wx {(ps) = eA0;'+'+" 

for some ex G C. Observe that for A; > 2, A > | if and only if 0-^+i+^ (^ ) fx (^s) provides 
an element of H^ that locally solves Qv = (the condition is A > 1 for A; = 2). Because 
kerQ is (globally) trivial, it is not possible to continue this solution (or a constant solution) 
to a global H^ solution of Q{Z-) w = on the whole sphere. 

We remark further that if /c > 2, the sections of E^ that satisfy Q^u = on the sphere 
minus a small neighborhood of the south pole that do extend to the north pole are exactly 
those of the form X]a>-^ cx4>J^fx (^s) near the south pole (for k = 2 the sum is over all 
A > 1). If A; > 2, the sections of E^ that satisfy Q^u = on the sphere minus a small 
neighborhood of the south pole that do extend to the north pole are exactly those of the 
form X]a<-^-i '^x'P^^fx (^s) near the south pole (for k = 2 the sum is over all A < 0). 

6.3.2. A related boundary value problem. In this section, we will replace the index problem 
for Q^ on the sphere with a related Atiyah-Patodi-Singer boundary problem, and we will 
explicitly determine the difference between these indices in terms of local heat kernel su- 
pertraces. Choose e > such that f (y) = y on the 5e-ball centered at the south pole. 
Consider all the data similar as before, but we modify the operator near the south pole 

Xk+i = — 1. We replace 0^ by r (0^) = exp f Cg + /^ " -jj-^dy ) for small 0^, where -0 : M — )■ M 
is a smooth function such that ip (y) = y in a neighborhood oi y = 3e and ip (y) = e for 
y < e, and where Ce is a constant chosen so that C^ + /^^ IhTl^y ~ log(3£)- Suppose that 

u (0s,6's) = '^x<!^~i'^^'Ps^f>' (^s) G r [S'',E^) is a local H^ solution to Q'^u = near the 



THE EQUIVARIANT INDEX 27 

south pole. Then 

m(0„^) : =u{r{<Ps),e)= Y, c^r-^f\{e) 



A<|-1 



X:..exp(-A(c. + f ^..))/.W 



A<f-1 

are local solutions to the equation 

(In the above sums, for k = 2 the condition A < | — 1 is replaced by A < 0.) For 0^ < £, the 
equation reads 

and for 0^ > 3e, the equation reads 



i'-^ihry'- 



Note that u is if-equivariant, because the transformation above affects the 0^ variable alone. 
Further, observe that the map -u — )■ m is continuous with respect to the C°^ norm and is 
injective, and the H^ condition on u translates to the boundary condition (0^ = 0) 

(or P>o (uIq) = if A; = 2) , 

where -P>fc_i is the spectral projection onto the span of the eigenspaces of {Q^^) corre- 
sponding to eigenvalues at least | — 1. Note that no such u may be continued to a global 
element of the kernel of the modified Q^, by the reasoning used in the previous section. 
Thus the boundary value problem for u with spectral boundary condition as above yields no 
kernel, as does the original problem for Q'^ on the sphere. 

Next, we modify the metric in a very specific way. We will choose the metric so that 

ds^ = [g {(f)s)f de"^ + d(j)l, (6.2) 

where g (0^) = 0^ in a neighborhood of 0^ = 3e (so that it agrees with the Euclidean metric), 
and such that g (0^) is constant if 0s < e (the cylindrical metric). Then, if f G F (S''^, E^^ 
is a local solution to the equation (Q'^) v = , then w = (Z^) v satisfies 

^(0,,^) : = w{r {(/),), 9) = J2cxr-'fxi(^) 

A>f 



J2 eg i^s)-''-'' exp (a (c, + ^'^ -1-^dy^ ) /. (9) 

A>| 



are local solutions to the equation 



(A:-l)^-(0.) 1 ^5+,~_n 

9 (0s) -ip (0s) 
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(In the sums above, ii k = 2 then the condition A > | is replaced by A > 1.) For 0^ < e, the 
equation reads 







v 


-9,, + -^Q'^ 


\ 

w = 
) 


0, 




and for 0^ 


> 3e, the equation 


reads 












V 


{k 


-l)^'(0.) 1 


1 

/(0s) 


g^+ w = o. 


This time 


w satisfies the boundary condition (0^ 


= 0) 












P^.iw,) 


= 










(or 


P^,{w\^) = Oiik = 


= 2) 


5 



where P< fe is the spectral projection onto the span of the eigenspaces of (Q"^^) correspond- 
ing to eigenvalues at most |. Note that no such w may be continued to a global element 
of the kernel of the modified Q^ ^ by the reasoning used in the previous section. Thus the 
index problem for the original Q^ (for u and vS) is the same as the boundary value "index 
problem" for u and w described as above. 

Observe that the operator and metric now fit the conditions of the Atiyah-Patodi-Singer 
theorem (^) for manifolds with boundary, but the boundary conditions are not the same. 
More precisely, the related situation is that of the equivariant version of the Atiyah-Patodi- 
Singer for elliptic operators in [181 Theorem 1.2]. The equivariant theorem actually gives 
a formula for the character ind^ (Q), which by ellipticity is a smooth function on H . We 
are interested in ind^ (Q), which is easily computable from ind^ (Q) by determining the /3- 
component of the character. All of the parts of the equivariant index formula (the integral of 
the heat supertrace, the eta invariant, and the dimension of the kernel) are smooth functions 
on H and can be computed similarly. The resulting equivariant eta invariant of any H- 
equivariant operator L is defined to be 



n{L^)= J] sign (A/^) I A/^ I 



(6.3) 



where (i : H ^ U (Vg) is an irreducible representation and where the sum is over all nonzero 
eigenvalues (including multiplicities) of L restricted to the space of sections of type (3. (Recall 
that the eigenvalues grow as in Formula (13. 3p .) 

The Atiyah-Patodi-Singer boundary conditions on the punctured sphere would be 

P>oM = 0; P<o^ = 0. 

If these conditions are used instead of the conditions induced from the closed manifold 
problem, note that again no such u could be continued to the north pole, because this would 
require that A < and A > | (or A > 1 for fc = 2) simultaneously. However, the possibility 
exists that some choices of w could be continued to sections of ker Q^~ over the north pole, 
requiring only that < A < | — 1 (or < A < for fc = 2). By Proposition I11.12| the only 
part of the spectrum of Q^^ in this range is the zero eigenvalue, and thus the equivariant 
Atiyah-Patodi-Singer index of the modified Q^ is 

- h (g^+'^) := -dimkerQ-^+''^ = -dimC^'^ = -dimE+'/^. (6.4) 
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By the equivariant version of the Atiyah-Patodi-Singer Theorem, we have that 

= f af'+ [ 5^ - ^ (r/ (g^+'O + h (Q^+'O) , or 

JS^-BASP) JBAd\DS^\ ^ 



'S^-B^{SP) 

where ofi is the the supertrace of the heat kernel of Q^ over the double DS^ of S^ (blown 
up at the south pole), where \DS^ means the half of the double, where S^ (5'P) means 
an e-neighborhood of the south pole, and where r] [Q^^''^) is the eta invariant of Q^~^'^. 
The set B^ (d\DS^) means the e-collar around the boundary d^DS'', so that ^DS'' = 
[S'' — Be (SP)) UBs (^d^DS'^y Thus, if a^ denotes the local heat supertrace of the operator 
on the sphere. 



= ind (Q'^) = / 
Js 



«5 



s 

S>'~BASP) JB^{SP) 



"5+ / "5 



Js^-B^SP) JBe{d\DS'') ^ 

If a^ denotes the Euclidean heat supertrace corresponding to the original operator Q^ on 



"5 ^ 
S''-B^{SP) JS''-B4SP) 



f a^ + O (e-'^/*) , and 

Js''-B4SP) 
JBASP) 



B,{0) JB,{SP) 

for some c > 0, since the local data is the same. Then 

/ a^= [ a' + U-V {Q'-"'') + h (g^+'O) + O (e^/*) , (6.5) 

the contribution of the equivariant heat supertrace of the constant coefficient operator Q^ in 
an e-ball around the origin of M'^. As explained in Remark II 1.13[ r/ (Q'^'*'''^) and h (Q'^"'"''^) 
are invariant under stable if -equivariant homotopies of the original operator Q. We note 
that the formula above is scale invariant and independent of all the various choices we made 
through the calculation. It expresses the index contribution of the Euclidean neighborhood 
in terms of the index contribution from the same neighborhood of the blown-up operator, 
where a small ball around the center of the Euclidean neighborhood is replaced by a collar. 
Because of the homotopy and scale invariance, this formula remains valid if the operator is 
blown up in any way so that it is constant on the small collared neighborhood and so that 
the spherical part Q^^'^ comes from the polar coordinate expression. Similarly, the metric 
may be chosen in any way as long as it is cylindrical on the collar. 
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6.4. The case k = 1. We repeat the analysis for the case k = 1. We consider a operator 

Q : C^ (M, C^ © C^) -^ C°° (M, C^ © C^) of the form 

Q = Ad, 

Ql 

Qi 

Ai J ^ ~ \ -Aa, if a; < ' 

where by assumption Ai G GL {d, C) and r = |x|. Suppose that H acts nontrivially on M by 
muhiphcation by itl, that H acts unitarily on each copy of C^, and that Q is if-equivariant. 
Let Ho be the (normal) subgroup of H that fixes M; then Hq contains the identity component 
of H, and H/Hq = Z2. Let 7 G -ff be chosen so that 7ifo generates H/Hq. Then we have 
that 

/lA = Ah for all h & Hq, and 

7A = -A7, 

or if we write 

we have 

h_ = Aih+A^'^ 

7- = -Aa+A^'- (6.6) 

Further, if iX G i]R\ {0} is an eigenvalue of A corresponding to eigenspace 






f+ \ / t^-l 



then 



and 

By (16. 6p . if PV^ 1^1 is the subspace of Eix fl C"'"'' = E^ix fl C"'^ consisting of the vectors of 
if-representation type [/9, Vg], then 

is the subspace of Eix fl C^^ = -E-ja H C^" consisting of vectors of i^-representation type (3, 
where (3 is the "conjugate" of (3, defined up to equivalence as 



(3{h) = /3 (h) for all h G Hq, and 

^(7) = -/3(7)- 
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Observe that W^ i^, is the (3 part of the A^ eigenspace of AlAi consisting of vectors of type 
/3, and W_ ,^ is the /3 part of the A^ eigenspace of AiAl consisting of vectors of type /3. Let 
P^ |A| • ^^^ ~^ ^± lAi denote the orthogonal projections. 

We now calculate the local contribution J^^_ a^ of the equivariant heat supertrace cor- 
responding to 

^ \^ -AiAl J "^■ 
We have that 

Since the fundamental solution of ^ — A^^ on M is . .] exp (— (x — y) /{AXH)), if 
K [t, X, y) is the kernel of the operator e~**^ on M, for < 5 < e, we have 

/ a^ = I I [ti h- K+{t,x,x) -ti h- R- (t,x,x)) xiijij dh 

dim Vi3 Jx=-5 Jx=-s JheHo 

+ / (tr 7/1 ■ K~^ (t, 7~^x, x) — tr 7/1 ■ K^ (t, 7^^x, x)) X/3 (^) dh dx 
^/le/fo |;,|_^ |A| V47rt 



-tr 7/^-$^^:|A| Xp{h)dhdx. 

Next, since /!°^ p^ exp (^:^) dx = |, 

di^ r "' = E ^n4^ / (t^ (^ ■ ^+,|A|) - tr (/^ ■ P: |A|)) ^^ dh 
aim V/3 J^=_5 m |A| V47rt Jhe/^o 



i 5^ / (tr (7/^ ■ P:,|a|) - tr (7/1 ■ P: |A|)) X/3 (/^) ci/i + O (e^/*) 



2 1^1^^ JheHo 



By (13. ip we conclude that the contribution of the equivariant heat supertrace on {—e, e) C M} 
is, for any 6 such that < 6 < e, 

r a^= [ a^ + - (dim (C'^+)'' - dim (C'^+)^) + O (e"^/*) . 

J-e J[-e,e]\[-5,5] 2 V / 

In order to make our formulas consistent throughout the paper, we define for the (equivariant) 
zero operator : C^+ — t- C^~ 

h (0^) := dim (C'^+)'' ; r] {O^) := dim (C''+)'' , (6.7) 
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SO that 

f aP= I a^ + \{h (0^) - r, (0^)) + O {e~''') . (6.8) 

J-e i[-e,£]\h<5,<5] 2 

7. Desingularizing along a singular stratum 

7.1. Topological Desingularization. Assume that G is a compact Lie group that acts on 
a Riemannian manifold M by isometries. We will construct a new G-manifold A^ that has a 
single stratum (of type [Go]) and that is a branched cover of M, branched over the singular 
strata. A distinguished fundamental domain of Mq in A^ is called the desingularization 
of M and is denoted M. We also refer to [1] for their recent related explanation of this 
desingularization (which they call resolution). 

A sequence of modifications is used to construct A^ and M G N. Let Mj be a minimal 
stratum. Let T^ {Mj) denote a tubular neighborhood of radius e around Mj, with e chosen 
sufficiently small so that all orbits in T^ (Mj) \ Mj are of type [Gk], where [Gk] < [Gj]. Let 

N' = iM\ % (M,)) UaT.(A./,) (M \ % (M,)) 

be the manifold constructed by gluing two copies of (M \ T^ {Mj)) smoothly along the bound- 
ary (see Section [7751 for the codimension one case). Since the T^ (M,) is saturated (a union of 
G-orbits), the G-action lifts to A^^. Note that the strata of the G-action on A^^ correspond 
to strata in M\T^ i^j)- If ^k H (M \ T^ {Mj)) is nontrivial, then the stratum corresponding 
to isotropy type [Gk] on A^^ is 

Nl = (M, n (M \ T, (M,))) U(M,naT.(M,)) (^^ ^{M\% (M,))) . 
Thus, A^^ is a G-manifold with one fewer stratum than M, and M \ Mj is diffeomorphic to 
one copy of (M \ T^ {Mj)), denoted M^ in A^^. In fact, A^^ is a branched double cover of M, 
branched over Mj. If A^^ has one orbit type, then we set A^ = A^"*^ and M = M^. If A^^ has 
more than one orbit type, we repeat the process with the G-manifold A^^ to produce a new 
G-manifold A^^ with two fewer orbit types than M and that is a 4-fold branched cover of M. 
Again, M^ is a fundamental domain of M^ \ {a minimal stratum}, which is a fundamental 
domain of M with two strata removed. We continue until A^ = A^*" is a G-manifold with all 
orbits of type [Go] and is a 2''-fold branched cover of M, branched over M \ Mq. We set 
M = M^ , which is a fundamental domain of Mq in A^- 

Further, one may independently desingularize M>j, since this submanifold is itself a closed 
G-manifold. If M>j has more than one connected component, we may desingularize all 

components simultaneously. The isotropy type of all points of M>j is [Gj], and M>j/G is 
a smooth (open) manifold. 

7.2. Modification of the metric and differential operator. We now more precisely 
describe the desingularization. If M is equipped with a G-equivariant, transversally elliptic 
differential operator on sections of an equivariant vector bundle over M, then this data may 
be pulled back to the desingularization M. Given the bundle and operator over A^-', simply 
form the invertible double of the operator on A^-'"'"^, which is the double of the manifold with 
boundary A^-' \ T^ (E), where S is a minimal stratum on A^-'. 

Specifically, we modify the metric equivariantly so that there exists e > such that the 
tubular neighborhood -B2£S of S in A^-' is isometric to a ball of radius 2£ in the normal bundle 
A^E. In polar coordinates, this metric is ds^ = dr"^ + da"^ + r^dO^, with r G (0,2e), da"^ is 
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the metric on S, and dOl. is the metric on S (A'^o-S), the unit sphere in NfjH; note that dOl. is 
isometric to the Euchdean metric on the unit sphere. We simply choose the horizontal metric 
on B2e'^ to be the pullback of the metric on the base S, the fiber metric to be Euclidean, 
and we require that horizontal and vertical vectors be orthogonal. We do not assume that 
the horizontal distribution is integrable. 

Next, we replace r^ with / (r) = [g (r)] in the expression for the metric, where g is defined 
as in f l6.2p . so that the metric is cylindrical for small r. 

In our description of the modification of the differential operator, we will need the nota- 
tion for the (external) product of differential operators. Suppose that F "^ X — )■ _B is a 
fiber bundle that is locally a metric product. Given an operator Ai^x '■ T (vr^^ (x) ,-E'i) — ?■ 
r (tt"^ (a;) , Fi) that is locally given as a differential operator Ai : T (F, Ei) — )■ T (F, Fi) and 
A2 : r {B, E2) —7- r (i?, F2) on Hermitian bundles, we define the product 

Ai,, * A2 : r (X, (Fi M F2) © (Fi M F2)) -^ T (X, (Fi M E^) © (Fi m F^)) 

as the unique linear operator that satisfies locally 



M,x * M 



on sections of 



AiMl 


-imAi 


IMA2 


A\mi 


?lKF2 


\ 


\mF2 


/ 



of the form ( ""^ ^ ""^ \ ^^^^^ ^^ ^^ ^p^ ^^^^ ^^^^ {B, F2), v^eV (F, Fi), t;2 G T (5, F2). 

y 171 L^ f2 y 

This coincides with the product in various versions of K-theory (see, for example, [2], [5^ 
pp. 384ff]), which is used to define the Thorn Isomorphism in vector bundles. 

Let D = D~^ : r{N\E~^) — >■ r{N^,E~) be the given first order, transversally elliptic, 
G-equivariant differential operator. Let E be a minimal stratum of N^ . Here we assume 
that S has codimension at least two. We modify the metrics and bundles equivariantly so 
that there exists e > such that the tubular neighborhood B^ (E) of S in M is isometric to 
a ball of radius e in the normal bundle NH, and so that the G-equi variant bundle F over 
Se (S) is a pullback of the bundle E\^ — )■ S. We assume that near E, after a G-equivariant 
homotopy D^ can be written on fig (S) locally as the product 

D+ = {D^ * Dj,)+ , (7.1) 

where Dj: is a transversally elliptic, G-equivariant, first order operator on the stratum S, 
and Dn is a G-equivariant, first order operator on B^ (S) that is elliptic on the fibers. If r 
is the distance from S, we write Dj^ in polar coordinates as 



Dn = Z{V^ + -D' 



where Z = —ia (Dn) (dr) is a local bundle isomorphism and the map D^ is a purely first 
order operator that differentiates in the unit normal bundle directions tangent to S^S. 

We modify the operator F)jv on each Euclidean fiber of NT, A S exactly as in Section [6.3.2j 
the result is a G- manifold M^ with boundary dM^ , a G- vector bundle E^ , and the induced 
operator D\ all of which locally agree with the original counterparts outside B^ (S). We may 
double M^ along the boundary dM^ and reverse the chirality of E^ as described in Section 
16.21 for the case of a hemisphere and in general in [121 Ch. 9]. Doubling produces a closed 
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G-manifold A^-', a G- vector bundle E^ , and a first-order transversally elliptic differential 
operator DK This process may be iterated until all orbits of the resulting G-manifold are 
principal. The case where some strata have codimension 1 is addressed in the following 
section. 

7.3. Codimension one case. We now give the definitions of the previous section for the 
case when there is a minimal stratum E of codimension 1. Only the changes to the argument 
are noted. This means that the isotropy subgroup H corresponding to S contains a principal 
isotropy subgroup of index two. If r is the distance from E, then D^ has the form 



Dn = Z {V^ + -D^ = ZV^ 



N = Z. . Vg^^-i^ I =Z;Va,, 

where Z = —ia {Dn) (<9r) is a local bundle isomorphism and the map D^ = 0. 

In this case, there is no reason to modify the metric inside B^ (S). The "desingularization" 
of M along S is the manifold with boundary M = Ad\Bs (S) for some < S < e; the singular 
stratum is replaced by the boundary dM = Ss (S), which is a two-fold cover of S and whose 
normal bundle is necessarily oriented (via dr). The double M' is identical to the double of 
M along its boundary, and as in the previous section M' contains one less stratum. 

7.4. Discussion of operator product assumption. We now explain specific situations 
that guarantee that, after a G-equivariant homotopy, D~^ may be written locally as a product 
of operators as in (17. ip over the tubular neighborhhood B^ (S) over a singular stratum S. 
This demonstrates that this assumption is not overly restrictive. In |10], a large variety of 
examples of naturally defined transversal operators similar to Dirac operators are explored 
and shown under suitable conditions to provide all possible index classes of equivariant 
transversally elliptic operators. The principal symbols of these operators always have the 
form described below, and they almost always satisfy one of the spin^ conditions. We also 
emphasize that one might think that this assumption places conditions on the curvature of 
the normal bundle iVS; however, this is not the case for the following reason. The condition 
is on the G- homotopy class of the principal transverse symbol of D. The curvature of the 
bundle only effects the zeroth order part of the symbol. For example, if F — )■ X is any fiber 
bundle over a spin'^ manifold X with fiber F, then a Dirac-type operator D on Y has the 
form D = dx * Dp + Z, where Dp is a family of fiberwise Dirac-type operators, dx is the 
spin'^ Dirac operator on X, and Z is a bundle endomorphism. 

First, we show that if D~^ is G-homotopic to a transversal Dirac operator at points of 
S, and if either S is spin^ or its normal bundle A^S — )■ S is (fiberwise) spin'^, then it has 
the desired form. Moreover, we also remark that certain operators, like those resembling 
transversal de Rham operators, always satisfy this splitting condition with no assumptions 
on S. 

Let NJ^ be normal bundle of the foliation J-" by G-orbits in E, and let NH be the normal 
bundle of S in M. Suppose that (after a G-homotopy) the principal transverse symbol of 
D'^ (evaluated at ^ G N*J-'(B iV*E) at points a: G E takes the form of a constant multiple of 
Clifford multiplication. That is, we assume there is an action c of CI {NJ-" © NTj) on E and a 
Clifford connection V on £" such that the local expression for D is given by the composition 

T{E)^T{E(g) T*M) "4^ T{E(g) {N*^ © A^*S)) 4 F (^ © {NT © A^S)) A T (E) . 
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The principal transverse symbol a (D^) at C,x ^ T*J] is 

i=i 
Suppose NT, is spin'^; then there exists a vector bundle S = S^ (B S^ — t- S that is an 
irreducible representation of CI (iVE) over each point of S, and we let E'^ = End(ci(Ars) (E) 
and have 

E ^ S^E^ 

as a graded tensor product, such that the action of CI {NT © iVS) = CI (iVS) §C1 (NT) (as 
a graded tensor product) on E~^ decomposes as 

c(x)®l -l®c(i/)*\ /5+®^^+\ /5-®E^^ 
1 ® c (y) c (x)* ® 1 y) • (^ 5- ® ^^- y) ^ 1^ 5+ ® E^- 

(see [7], [SS])- If we let the operator d'^ denote the spin^ transversal Dirac operator on 
sections oi 7r*S — t- iVE, and let D-£ be the transversal Dirac operator defined by the action 
of CI {NJ-") on E^, then we have 

up to zero*'^ order terms (coming from curvature of the fiber). 

The same argument works if instead we have that the bundle NT — t- S is spin'^ in addition 
to the assumption that D restricts to a transversal Dirac operator on the stratum S. In this 
case there exists a spin'^ Dirac operator d^ on sections of a complex spinor bundle over S is 
transversally elliptic to the orbit foliation J-", and we have a formula of the form 

again up to zeroth order terms. 

Even if iVE — >■ E and NT — )■ E are not spin'^, many other first order operators have 
splittings as in Equation (17. ip . For example, if D~^ is a transversal de Rham operator from 
even to odd forms, then D^ is the product of de Rham operators in the A^E and NT 
directions. 

8. Heat Kernel Splitting Formula 

8.1. Tensor Products of Representations, li H is a compact Lie group and V = Vi V2 
is a tensor product of if -modules, and if {[cTj, VF^J : j > O} are the irreducible unitary 
representations of if , counted only up to equivalence, then we define the integers 7^^ (Clebsch- 
Gordan coefficients) as 

7^f, = multiplicity of aj in o"a ® (Tb 
= rank Hom^ {W^^ , W^^ ® W^^) , 
and 

j 
Quite often these integers are 1 or (see [39], ^5\). For example, if ctq denotes the trivial 
representation, then 

f 1 if CTfe = CT* 



"'' ^ otherwise 
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It is important to realize that for fixed j, as above there may be an infinite number of 7^^ 
that are nonzero. On the other hand, if two of the numbers a,b,j are fixed, then only a 
finite number of the 7;^^ are nonzero as the third index varies over all possibilities. 

8.2. Decomposition near an orbit. With notation as before, let S be a minimal stratum 
of the G-action on the vector bundle E — )■ M, corresponding to an isotropy type [H]. We 
modify the metrics and bundles equivariantly so that there exists e > such that the tubular 
neighborhood -B^S of S in M is isometric to a ball of radius e in the normal bundle NTj 
(endowed with the natural product-like metric), and so that the G-equivariant bundle E 
over i^^E is a pullback of the bundle E\j. — )■ S. 

Choose Sq = CE^ C E to be a component of S relative to G (Definition 14. ip . Note that 
S is partitioned into a finite number of such components, which is the number of components 
of G\S. We assume that 

E\j.^= En®Ej:, 

the graded tensor product of two G-vector bundles over Eq, as in Section [71 We extend B^T, 
to a sphere bundle ST, — y S by modifying the metric near the boundary and doubling. We 
wish to compute the local supertrace of a heat operator corresponding to a G-equivariant, 
transversally elliptic operator, restricted to sections of type p, on STlj. . Let Ox be an orbit 
in Eq C S, with x G S^, and let Sq^ -^ O^, respectively Bq^ — )■ O^, be the restriction of the 
Euclidean sphere bundle ST, — > T , respectively B^T — )■ E. By the constructions in Section 
[71 the group action, tensor product structure, and the equivariant operator naturally extend 
from B^T to ST, and the local supertraces of the heat operators on Bi^T and ST agree in a 
neighborhood of T, up to O (e~^/*) for some c > 0. The space of sections T ( 5*0^, E) satisfies 

r (5o,, E|^J = r (a, FA.gEs|e,J , 
T{ST\^^,E\^J=T{T^,F^^E^), 
where Fjy — )■ S is the infinite dimensional equivariant vector bundle whose fiber is 

Fn,z = r [STz, Ejylg^J , Z E Tc 



JQ,. 



Observe that F^^gx and -Es.gx are Gg^^-modules, where Ggx = gGxQ ^ = H. If F^ is a fine 
component of F^ associated to (a, [a]) as in Definition 14.31 let 

• W^ = Wa,[cT] be the canonical isotropy G-bundle adapted to F^ (Definition 14.91 
Lemma 14. 8p , 

• rrib be the associated multiplicity of each irreducible isotropy representation present 
mW\ 

• dfy be the associated representation dimension of each irreducible isotropy represen- 
tation present in W^ (and thus F^), and 

• Ub be the inequivalence number, the number of inequivalent irreducible representation 
types present in W^ (and thus F^). 

• Note rank (W^) = mbdbni,. 

We remark that at this time there are an infinite number of such components F^, but 
soon we will restrict to a finite number. 

With notation as above, let [p, Vp] be an irreducible unitary G-representation. We will re- 
strict a transversally elliptic, G-equivariant differential operator to the space T (T, Fni^Ey;) 
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of sections of type p. By Frobenius reciprocity, 

Home [Vp, r (a, Fm®E^)) = Hom^ (V^Res(p), (i^^i^s) J 

^ 0HomH(l^Res(p),(i^^§^E)J. (8.1) 

b 

If {o"a} is the finite set of if-representation types present in Ey.^x and {aj} is the finite set 
of if -representation types present in VRes(p), then by the remarks in the previous subsec- 
tion, the Clebsch-Gordan coefficients 7^^ are nonzero only for a finite number of irreducible 
representation types [cip]. Therefore, only a finite number of h satisfy 

Hom^ (\/Res(p), (F^gEs) J ^ 0. 

Moreover, if we consider all such h over every a; G E„ C E, only a finite number of h would 
yield a nonzero Homj:^ (VRes(p), {F'^^Ey) ). Let B be this finite set of indices, and thus we 
have 

r (E,, FM®Ej,y = r (E„, F^S^s)" . 

In the equation above, we may of course replace the smooth sections with the L^ sections. 

Let K [t, Hxi VxY 1 y £ SY^x denote the heat kernel of a G-equivariant transversally elliptic 
first-order symmetric operator D*D of the form D = D^ * D-^ on T (Eq,, Fjy^E-^) ; we 
further restrict this kernel to T {Bq^, EY or V {Sq^, EY . We assume that D]^ is a family of 
first order elliptic operators on fibers -F/v,x, and we also assume Djq is G-equi variant, with 
corresponding local equivariant fiberwise heat kernel K^q. We likewise assume that Ds is 
a first order transversally elliptic operator on sections of Fs over E with equivariant heat 
kernel Ky.. 

Consider a small e-tubular neighborhood T^ C Eq C E, T^ = G Xj;/ Z}^ around a fixed 
orbit Ox in E, where x & D^ G E^ is a ball transverse to O^- The space of sections 
L^ (T;;, F^i^Ey) decomposes using Lemma 14.121 as 

® 

rib 



r\-/ 



rib 

i=i 

^ Hom^ (W,"!^^ , W^.,) ® Hom^ {w^^ , F^|^J gL^ (t,, W^ ® E^) (8.2) 
i=i 

with the isomorphism given by evaluation, and then D ® 1 acts by 1 ® Dj^® (1 ® D-^Y ■ 
Here, corresponding to the normalizer-conjugate representations [crj,iycrj is the isotypical 
decomposition W^''|r) = ©W^t of the canonical isotropy G-bundle W'^ , which we may 

define over the small transversal neighborhood D^, and W^ — t- T^ is the bundle G Xh 

W^ -^ G Xh D, = T,. Note that W\ = 01^/, and the multiplicity of the irreducible 

j 
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if-representation actually present in each Wf is nib, with p G S^ fl T^. Each bundle 



H\ ""jId ' ''j\d, I =^ ° ^^- 



Honiff [W!L , VrtL ] ^ C^b X D, is trivial. 



Given an operator P, let Et (P) = exp {—tP*P) denote the associated heat operator (de- 
fined through context). We wish to calculate the local supertrace of Et (D) = exp {—tD*D) 
on L^ (Te, F^®Ey) , which is the same as ^— times the local supertrace of Et (D) ® 



"6 



1 =Et {D ® 1) on L^ [Te, F^^Ej^Y ® Hom^ (w^\^^ , W^\^] . According to the oper- 

ator product assumption and decomposition (18.21) . we then have the pointwise supertrace 
formula 

X e De,y e [(x,p)] e T^, 
since supertraces are multiplicative on graded tensor products and where I'^j is the identity 
bundle map on Hom/^ f ^j\d ' ^'^j ) ~^ ^^ ^^*^ "'"'''"' ^^ ^^^ identity bundle map on W^ — )■ 
Tg. Here Z)^-' means the restriction of D]^ to Hom// (VFo-^. ,F^), and so the supertrace 
str (Et (-Djv ) ) is the same as J-str (^Et (D^))^, where D'^ is the restriction of D^ to 

F;/^^ = T{si:,,E^\,^J^,xeD,. 

Then 

Str [Et (Df- on T.) = — — J^ str (E, (Z^^O). str {Et (l^- ® D,)^^ , 

X e £>£,!/€ [(x,]9)] G Te. 

By (16. 5p and (16. 8p . the integral of the pointwise supertrace str [Et {Dn)) (-^p? Zp) over a 
small normal ball Zp G -B^ containing p in SpS is the same as 



/ str {Et (D;0)p (^P' ^p) ~ / ~ str (e, (d^ 






+ l{-v{D'^'''^) + h{D'^'''^)), 
with the tilde corresponding to the equivariant desingularization of the origin as in Section 

El 

We now discuss a general situation. Let u be an eigenvector of a G-equivariant fiberwise 
operator L on a fiber E^ of an equivariant bundle over a G-manifold X with single orbit 
type G/H . Assume that x G X^, and n & N {H). Then nu is an eigensection of L over 
Enx with the same eigenvalue. Moreover, if u is an element of an iZ-irreducible subspace of 
type 0", then nu is an element of an irreducible subspace of type a". This implies that the 
Schwarz kernel Kl of L at x is mapped to the kernel Kl of L at nx by conjugation by n, and 
thus the kernel Kl ^ restricted to sections of type a at x is conjugate to the kernel K'['^^ at 
nx (see also equations (15.31) . (I5.4p ). Moreover, the kernels K^, Kl, Kl" vary smoothly as a 
function of x G X^ , and in fact any fiberwise spectral invariant of L must vary continuously 
with X G X^. 
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Next, consider the special case where L : F (X, E) —^ T (X, E) has integer eigenvalues 
(as in the case of the operators D^^ - see Corollary 111.121 and Remark I11.13p . Then the 
eigenvalues of L, L°", and L°"" must be locally constant on X^ . This implies that if n e iV [H) 
maps a connected component X^ C X^ to itself, then all spectral invariants of L'^ and L""" 
are identical and constant, when restricted to X^ . Now, let U be an open subset of X^, and 
let E^ be a fine component of E. If [cr] , [a'] G if are different representation types present 
in a specific -E^Lr, then a consequence of the argument above is that all spectral invariants 
of L'^\u and L'^'\tj are identical and constant. 

As a result, in the displayed formula above, | (—77 (Z^'^^''*'-') + /;, (Z}'^+'^'-')) is independent 
of j and is a constant on each connected component S^ of S^ (and thus on Eq, = GS^ C S). 
In particular, 

\ {-V {D'^^'') + /. (Z^^+'^'^)) = ^ (-r^ (D^+'^) + h (D^+'^)) , 

where D^^'^ refers to the restriction of D^^ to the sections in the fine component F^. We 
now integrate over p G T^ to get 



/ sti{Et{DfA{zp,Zp) 



"6 



^—rY.1 [ stiiE.iD"^)) {z„z,)stT{E,{l''^^Dj,Y){p,p) 



mbUbdh ~[Jt^ Jzp&BN 



^6 /• p ^ 

Y. ^str(F,(D;^)) {z,,z,)sii{Et{l''^®D^Y){p,p) 



■rib 



mbUhd, 



hfb L k ^-' ^""'"'^ + ' ^""'""^^ ^ ''' ^""^ ^''' "^ ""^^'^ ^^'^^ 



/ stilEtiD) '" ) {zp,Zp) 



1^ (-, [D^-^^) + /. (D-+'^)) £ str (E, (1^ ® D^Y) 



{p,p) 



2mbnldb 

where 1^ ® D^, is the differential operator on W^ ® E^, over the G-manifold S^^. 

Thus, in calculating the small t asymptotics of Jg ,^. stiK {t, Zp, ZpY = J str {E^ (DY) {zp, Zp) 

with Et {DY = exp {—tD*D)^, it suffices to calculate the right hand side of the formula above 
over the region i?^ and sum over fine components b E B, using the heat kernel coming from 
the blown up manifold. Thus, by integrating over any open saturated subset ?7 of Sq, C S, 
we conclude that as t — )■ 0, 

/ str.ft' (t, Zp, ZpY ~ /,-^^ strii' (t, Zp, ZpY 
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with stiK^ {t,p,pY = str i^Et (l^ ® ^^)^) {PiP) i^ ^^e local heat supertrace corresponding 
to the operator V> ®D^onV (f/, W^ ® E^Y . 



9. The Equivariant Index Theorem 

9.1. Reduction formula for the heat supertrace. As before, let ii^ be a graded Her- 
mitian vector bundle over a closed Riemannian manifold M, such that a compact Lie group 
G acts on (M, E) by isometrics. Let L> = £>+ : T (M, E+) -^ T (M, E') be a first order, 
transversally elliptic, G-equivariant differential operator. Let S be a minimal stratum of the 
G-manifold M. We modify the metrics and bundles equivariantly so that there exists e > 
such that the tubular neighborhood -B^S of S in M is isometric to a ball of radius e in the 
normal bundle A^S, and so that the G-equivariant bundle E over 5^ (S) is a pullback of 
the bundle E\j^ — t- S. We assume that D^ can be written on each saturated open set U 
contained in B^ (E) as the product 



£)+ = [Dn * Dj: 



,+ 



where D-^ is a transversally elliptic, G-equivariant, first order operator on the stratum E, 
and D]^ is a G-equivariant, family of elliptic first order operators on the fibers of B^ (S). In 
fact, we only require that D~^ is of this form after an equivariant homotopy. Further, we 
may assume that D^ is a first order operator with coefficients frozen at S so its restriction 
to a normal exponential neighborhood B^Hx, a; G S, is a constant coefficient operator. If r 
is the distance from S, we can write Dn in polar coordinates as 



where Z = —ia (-Dat) (<9j.) is a local bundle isomorphism and the map D^ is a purely first 
order operator that differentiates in the unit normal bundle directions tangent to S'^S. Note 
that we allow this to make sense if S has codimension one by setting D^ = and dr to be 
the inward-pointing vector. 

Let p : G ^ U {Vp) be an irreducible representation. Let f/ be a saturated (ie G-invariant) 
open subset of M such that G\U is connected. From Equation (15.21) . we wish to compute 
the quantity 



lu = / sir {K{t,{x,z^),{x,z^)y) \dz^\ \dx\ , 

^xesnl/ Jz^eBe{T,)^nu 

where we choose coordinates w = {x,Zj.) for the point exp;;^ (z^), where x G S, z^ G -B^ = 
i?e [Nx (S) ,0), and exp;;!: is the normal exponential map. In the expression above, \dzx\ is 
the Euclidean density on iV^(S), and \dx\ is the Riemannian density on S. Recall that 
K (t, (x, Zx) , (x, Zx)y is a map from E,^^^^^ = Ex to itself. 

First, observe that the small t asymptotics of this integral over Bg, (S)nt/ may be computed 
using a heat kernel for another differential on a neighborhood of a different manifold, as long 
as all the local data (differential operator, vector bundles, metrics) are the same. In particular 
we may use the manifold S'S as in the previous section. Using Equation (18. 3p . 
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/. 



i,U 



str (K {t,x,xy] \dx\ 
2 ^ n^rank M/" ' Aesnc/ 



2 
fees 

where ~ means equal up to O (t^) for large k, where B^ (S) nU is the fundamental domain 

in the desingularization of B^ (S) fl U and where K is the suitably modified heat kernel. 
We note that the equation above remains true if S is of codimension 1, because in this case 
£)S+,b _ Qb^ ^^^ ^g ^gg ^YiQ definitions (16. 7p . 

Let M be the equivariant desingularization of M along E, and let E^ be the equivari- 
ant bundles over M induced from E^ with transversally elliptic operators -0=*= (see Section 
I7.ip . Let K"^ (t, -, ■) denote the equivariant heat kernels corresponding to the extensions of 
D^D^ + C — A/3 to the double of M restricted to sections of type /3 (with reversed orienta- 
tions of the induced bundles E^ in the usual way) . Then the heat kernel supertrace formula 
becomes 



/ str {K{t,x,xY) \dx\ ~ / str (K{t,x,xy) \dx\ 



^lE 



-i-^ {-V {D'^^') + h (Z^^+'^)) 1^ ^^^ str (ir| it,x,xr) \dx\ 



2 f^ ribiank W^ JG\(c/ns) 

The heat kernel K^ is that corresponding to the operator (1 ® D-^Y induced by the operator 
1 ® De on r (S, W^ O Es) on the quotient GX {U n E) as described in Section gH 
We assemble the results above into the following theorem. 

Theorem 9.1. (Reduction Formula for the Equivariant Supertrace) Let E be a graded Her- 
mitian vector bundle over a closed Riemannian manifold M , such that a compact Lie group 
G acts on (M, E) by isometrics. Let S denote a minimal stratum. Let D^ : F (M, E^) — t- 
T{M.,E~) be a first order, transversally elliptic, G- equivariant differential operator. We 
modify the metrics and bundles equivariantly so that there exists e > such that the tubular 
neighborhood B^T, of T, in M is isometric to a ball of radius e in the normal bundle NTi, 
and so that the G- equivariant bundle E over B^ (S) is a pullback of the bundle E\^ — )■ S. 
We assume that near S, D is G-homotopic to the product 

where D^, is a global transversally elliptic, G- equivariant, first order operator on the stratum 
E, and D^ is a G -equivariant, first order operator on B^H that is elliptic and has constant 
coefficients on the fibers. If r is the distance from S, we write Djq in polar coordinates as 



Dn = Z{V^ + -D^ 



where Z is a local bundle isomorphism and the map D^ is a purely first order operator 
that differentiates in the unit normal bundle directions tangent to S'^^S. Let U be a saturated 
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(ie G-invariant) open subset of M such that G\U is connected. Then as t -^ 0, 
str (K {t,x,x)'^) \dx\ ~ / str iK{t,x,x)^j \dx\ 

{-T] {D^+'') + h {D^+^')) [ sti (Kl{t,x,xy) \dxl 



x&J JU 



^E 



2 f^ n^rank W^ JG\(c/ns) 

Here, the superscript W^ -^ T^a is a canonical isotropy G-bundle over the component S^ 
relative to G that contains U, K^ refers to the equivariant heat kernel corresponding to a 
twist of Dj] by W^ — )■ Sq,. Since K^ is an equivariant heat kernel on the component S^, 
it induces a heat kernel K^ = (-ft'l) on the quotient G\T,a- Also, U is the equivariant 

desingularization of U along the stratum S, and the kernel K is the corresponding heat 
kernel of the double. 

We refer the reader to Definitions 14.11 and I4.9[ Note that only a finite number {b G B) 
of W^ result in heat kernels K^ (t, x, xY that are not identically zero, by the discussion 
following IKTh . 

9.2. The main theorem. To evaluate ind'' (D) as in Equation (15. 2p . we apply Theorem 
19.11 repeatedly, starting with a minimal stratum and then applying to each double of the 
equivariant desingularization. After all the strata are blown up and doubled, all of the 
resulting manifolds have a single stratum, and we may apply the results of Section 14.11 We 
obtain the following result. In what follows, if U denotes an open subset of a stratum of 
the action of G on M, U' denotes the equivariant desingularization of U, and U denotes the 
fundamental domain of U inside U', as in Section [71 We also refer the reader to Definitions 
OandSH 

Theorem 9.2. (Equivariant Index Theorem) Let Mq be the principal stratum of the ac- 
tion of a compact Lie group G on the closed Riemannian M, and let J]ai,...,^ar denote 
all the components of all singular strata relative to G. Let E -^ M be a Hermitian vector 
bundle on which G acts by isometrics. Let D : r{M,E~^) — )■ r{M,E~) be a first order, 
transversally elliptic, G-equivariant differential operator. We assume that near each J^a , D 
is G-homotopic to the product 0^*0°"^ , where Dn is a G-equivariant, first order differential 
operator on B^T, that is elliptic and has constant coefficients on the fibers and D"'^ is a global 
transversally elliptic, G-equivariant, first order operator on the Sq,^. . In polar coordinates 

Dn = Z, (Vg + Id^ 

where r is the distance from S^^., where Zj is a local bundle isometry (dependent on the 
spherical parameter) , the map Dj is a family of purely first order operators that differentiates 
in directions tangent to the unit normal bundle ofLj. Then the equivariant index md'' {D) 
satisfies 

ind''(D) = / _A',{x) \dx\ +V/3(S„J , 



beB 
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where 

(1) Aq (x) is the Atiyah-Singer integrand (]3] j, the local supertrace of the ordinary heat 
kernel associated to the elliptic operator induced from D' (blown-up and doubled from 
D) on the quotient Mq/G, where the bundle E is replaced by the bundle £p (see 
Section 4-l\ )- 



(2) Similarly, A^^ is the local supertrace of the ordinary heat kernel associated to the 
elliptic operator induced from (1 (g) D^^) (blown-up and doubled from 1 ® D"'^ , the 
twist of 0°"^ by the canonical isotropy bundle W^ — )■ Sq,^. ) on the quotient YI^,/G, 
where the bundle is replaced by the space of sections of type p over each orbit. 

(3) ri ( D- "*"' ) is the eta invariant of the operator D^^ induced on any unit normal sphere 



S^T^a , restricted to sections of isotropy representation types in W^, defined in (E3J 
and in ( [6'. 7p for the codimension one case when D- "*"' = 0^' . This is constant on 

(4) h ( D- ^' j is the dimension of the kernel of D- ^' , restricted to sections of isotropy 

representation types in W!^., again constant on on Sq,.. 

(5) rib is the number of different inequivalent Gx -representation types present in each W^, 

X G /-laj ■ 

Remark 9.3. Note that only a finite number (6 G B) of W^ result in integrands A^-^[x) 
that are not identically zero, by the discussion following (18. ip . 

Remark 9.4. If the stratum Sq,^ is a single orbit, then we have in the Theorem above that 
1 >r^ 1 



2dimi;^dim(iy.) ^ ^^ j+/^li^ jj, 



p 
where the restriction of p to if is Res ([p, V^]) = n^ [a, Wa-]- 

(7 

Remark 9.5. Note that the quantities V i^j ' ) ^^^ ^{^j ) ^^^ invariant under equi- 
variant stable homotopies of the operator D, as explained in Remark 111.131 

Theorem 9.6. (Invariant Index Theorem) With notation as in the last theorem, if po is the 
trivial representation, then 

ind^«p) = / _K{^) \dx\ +y;/3(s,j , 

6G-B " ^G\1.Q^. 

where b & B only if W^ corresponds to irreducible isotropy representations whose duals are 
present in £'"•', the bundle on which D^ acts. 

Proof. If [a, Wa] , [t, Wr] G H, we have (Wo- ® Wr)" = unless r ~ a*, and in this case 

{Wa (g) Wrf = C. D 
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10. Examples and Applications 

10.1. Equivariant indices of elliptic operators. Clearly, Theorem 19.21 and Theorem 19.61 
apply when the G-equivariant differential operator D : r{M,E^) — )■ r{M,E~) is elliptic. 
In this case, the kernel and cokernel are finite-dimensional representations of G, and thus we 
have the fact that the Atiyah-Singer index satisfies 

ind (D) = J2 ind'' (D) dim (Vp) , 

[p] 

and the equivariant indices satisfy 

ind^ (D) = J2 ind'' (D) [p] e R (G) 

[p] 

indgiD) = 5^ind''(D)xp(<7), 

[p] 

with all sums, integers, and functions above being finite. Even in this elliptic case, the result 
of the main theorem was not known previously. 

For example, suppose that D is a general Dirac operator over sections of a Clifford bundle 
E that is equivariant with respect to the action of a Lie group G of isometrics of M. If we 
apply Theorem 19.21 to this operator, all of the operators in the theorem are in fact Dirac 
operators. That is, the operators Djsi and Dj^ are Dirac operators formed by restricting 
Clifford multiplication and the connections to the normal and tangent bundles of the stratum 
Sj. The spherical operators Df are also Dirac operators induced on the unit normal bundles 
of the Sj. Further, in calculating the Atiyah-Singer integrands on the quotients, note that 
the operators on the orbit spaces are Dirac operators twisted by a bundle. 

10.2. The de Rham operator. It is well known that if M is a Riemannian manifold and 

/ : M — !■ M is an isometry that is homotopic to the identity, then the Euler characteristic 
of M is the sum of the Euler characteristics of the fixed point sets of /. We generalize this 
result as follows. We consider the de Rham operator 

d + d* : fi"™" (M) ^ n°'^'^ (M) 

on a G-manifold, and the invariant index of this operator is the equivariant Euler character- 
istic x^ (M) , the Euler characteristic of the elliptic complex consisting of invariant forms. 
If G is connected and the Euler characteristic is expressed in terms of its p-components, 
only the invariant part x*^ (M) = x''° i^) appears. This is a consequence of the homotopy 
invariance of de Rham cohomology. Thus x*^ (M) = x (M) for connected Lie groups G. In 
general the Euler characteristic is a sum of components 

xiM)=J2x'iM), 

[p] 

where x^ {M) is the alternating sum of the dimensions of the [p]-parts of the cohomology 
groups (or spaces of harmonic forms). Since the connected component Gq of the identity in 
G acts trivially on the harmonic forms, the only nontrivial components x^ (M) correspond 
to representations induced from unitary representations of the finite group G/Gq. 
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In any case, at each stratum S^,^ of codimension at least two in a G-manifold, we may 
write the de Rham operator (up to lower order perturbations) as 

d + d* = Dn* Dy;, 

where Djv and D^, are both de Rham operators on the respective spaces of forms. Further, 
the spherical operator D'^ is simply 

D^ = -c (Or) {d + d*)^ , c (Or) =drA -drj 

where {d + d*) is a vector- valued de Rham operator on the sphere. We will need to compute 
the kernel of this operator, which is related to the harmonic forms on the sphere; it is spanned 
by {l,dr,u,dr A u}, where u is the sphere volume form. The eigenforms of this operator 
are integers, and if a + (ir A /3 is an eigenform of D^ corresponding to eigenvalue A, then 

\{a + drAP) = -c{dr) {d + d*)^ {a + dr A f3) 

= -drA{d + d*fa-{d + d*f 13, 



so that 



Also 



{d + d*) a = —\f3;{d + d*) /3 = — Aa, or 
{d + d*f{a±/3) = T^{a±/3). 



D^{a-drA/3) = -c{dr) {d + d*f {a - dr A /3) 



= \dr A f3 — \a = —A {a — dr A /3) , and 
D^{l3±drAa) = ±\{l3±drAa). 

Thus the spectra of both D and {d + d*) are symmetric. Let [Gj] be the isotropy type 
corresponding to the stratum S^ . If we restrict to forms of Gj-representation type a, the 
forms a,P would necessarily be of that type, but the symmetry of the spectra would remain. 
Thus for the de Rham operator, 

at each stratum. The dimension h (^D^^'"^ of the kernel is not always the same; the + 
component of the forms contains at most the span of {1, u} if the codimension of the stratum 
is odd and at most the span of {1, dr A u} if the codimension is even. Observe that 1, u, and 
drAu are invariant under every orientation-preserving isometry, but u and drAu change sign 
under orientation reversing isometries. Thus, the only representations of Gj that appear are 
the induced one-dimensional representations of Gj on the transverse volume form to Sq,.. 
If some elements of Gj reverse orientation of the normal bundle, then let C,g denote the 
relevant one- dimensional representation of Gj as ±1. Then 

{2 if o" = 1 and Gj preserves orientation 

1 if o- = 1 and Gj does not preserve orientation (^^\ ^\ 

1 if o" = ^Gj and Gj does not preserve orientation ^ ' ^ 

otherwise 

The orientation line bundle C^. — > E^ of the normal bundle to E^ is a pointwise repre- 
sentation space for the representation ^g , and it is the canonical isotropy G-bundle W^ 
corresponding to (q;j, [CgJ)- We may also take it to be a representation bundle for the 
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trivial Gj-representation 1 (although the trivial line bundle is the canonical one). The main 
theorem takes the form 

md'id + d*) = -^ f _A',ix) H +y2H^».) ' 
aim Vp Jc\Mo j 

In this case it is useful to rewrite Jqk^ Aj [x,Cmj) \dx\ as /^ K'^ [x^C^^) \dx\ before 
taking it to the quotient. We see that K^ [x,Cnj) is the Gauss-Bonnet integrand on the 

desingularized stratum Sq,., restricted to /^at. -twisted forms of type [p]. The result is the 
relative Euler characteristic 

/ K^ (x, Cn,) \dx\ = x'' (Sa^, lower strata, Cn^) , 

Here, the relative Euler characteristic is defined for X a closed subset of a manifold Y as 
X {Y, X,V) = X {Y, V) — X (^) "1^)) which is also the alternating sum of the dimensions of the 
relative de Rham cohomology groups with coefficients in a complex vector bundle V -^ Y. 
The superscript p denotes the restriction to the subgroups of these cohomology groups of 
G-representation type [p]. Note that if y is a G/Gj-bundle, x (X: ^Y is the alternating sum 
of the dimensions of subspaces of harmonic forms with coefficients in the G-bundle V ^ Y 
with representation type [p]. Further, since Sq,. is a fiber bundle over G\Sq. with fiber 
G-diffeomorphic to G/Gj, we have 

/ i^j' (x, Cn,) \dx\=x'' {G/Gj, Cn,) X (G\Sc,^., G\lower strata) , 

by the formula for the Euler characteristic on fiber bundles. A similar formula holds for the 
principal stratum, with no orientation bundle. Putting these facts together with Theorem 
HiHand ind^ {d + d*) = ^.^^ x^ (M), we have the following result. 

Theorem 10.1. Let M be a compact G-manifold, with G a compact Lie group and principal 
isotropy subgroup Hp^. Let Mq denote the principal stratum, and let T,ai,---,^ar denote all 
the components of all singular strata relative to G. We use the notations for x^ O^i^) ^'^^ 
X^ {Y) as in the discussion above. Then 

XP{M) = x''{G/Hp,)xiG\M,G\singular strata) 

+ 2_. X^ {G/Gj , /^atJ X {G\'Saj, G\lower strata) , 
j 

where Cn is the orientation line bundle of normal bundle of the stratum component Sq,.. 

Example 10.2. Let M = S"", let G = O (n) acting on latitude spheres (principal orbits, 
diffeomorphic to S'"'^^). Then there are two strata, with the singular strata being the two 
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poles (each with Euler characteristic 1). Without using the theorem, since the only harmonic 
forms are the constants and multiples of the volume form, we expect that 

^P(Cn^_f (-1)" ifp = e 

^ ^ ^ \ 1 if p = po = 1 ' 

where ^ is the induced one dimensional representation of O {n) on the volume forms. We 
have that 

i-ir' ifp = e 



X" (G//7pr) = x" (5-^) = \ 



if p = po = 1 ' 
and 

X {G\M, GXsingular strata) = x([-l,l],{-l,l}) 

= -1. 

At each pole, the isotropy subgroup is the full O (n), which may reverse the orientation of 
the normal space. Then 

1 ifp = po = l. 



X'(G/G,.£„,)=x'(pt) = {j llJ^ 



Also, for each pole S^., 

X [G\T,aj, G\lower strata) = x (pt) = 1- 
By Theorem llO.il we have 

' :-ir ifp=e 



^ ^ ' — 1 it p = Po = 1 

Jo ifp = e 
'^X 2-1 ifp = po 

(-1)" ifp = e 
1 if p = Po ' 

which agrees with the predicted result. 

Example 10.3. If instead the group Z2 acts on 5"" by the antipodal map, note that 

1 — 1 = ifp = po and n is odd 

p , ^^n\ _ J 1 if P = Po and n is even 

I 1 if p = ^ and and n is even 

otherwise 

since the antipodal map is orientation preserving in odd dimensions and orientation reversing 
in even dimensions. On the other hand, by Theorem 110.11 since there are no singular strata, 
we have 

;^^(5") = x" (C/ifpr) X (G\M, G\singular Strata) 

1 ■ X (M-P") if p = Po or ^ and n is odd 
1 ■ X (M-P") if p = Po or ^ and n is even 
■ X (M-P") otherwise 

if p = Po or ^ and n is odd 

1 if p = Po or ^ and n is even , 
otherwise 
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which agrees with the direct computation. 

Example 10.4. Consider the action of Z4 on the torus T^ = M^/Z^, where the action is 
generated by a | rotation. Exphcitly, A; G Z4 acts on I ^ J by 

Endow T^ with the standard flat metric. The harmonic forms have basis {1, dyi, dy2, dyi A dy2}. 
Let pj be the irreducible character defined by fc G Z4 1— )■ e^^^'^^'^. Then the de Rham 
operator {d + d*Y° on Z4-invariant forms has kernel {cq + Cidyi A dy2 : Co,Ci G C}. One 
also sees that ker {d + d*Y^ = span {idyi + dy2}, ker {d + d*Y^ = {0}, and ker {d + d*Y^ = 
span {—idyi + dy2}. Then 

X''^ {T') = 2,x'' (T^) = x'' {T') = -1,X'' {T') = 0. 

This illustrates the point that it is not possible to use the Atiyah-Singer integrand on the 
quotient of the principal stratum to compute even the invariant index alone. Indeed, the 
Atiyah-Singer integrand would be a constant times the Gauss curvature, which is identically 

\ / ^ ^ ^ 



zero. In these cases, the three singular points '^i = I n ) ' '^2 = I 1 1 , «3 = I ? 

certainly contribute to the index. The quotient T^/Z4 is an orbifold homeomorphic to a 
sphere. 

We now compute the Euler characteristics x^ (T^) using Theorem llO.il First, G/Hp^ = G 
is four points on which G acts transitively, and thus x^ {G/H^j) = 1 for each possible choice 
of p. We have x {'^4\T^, {3 points}) = x ('5'^, {3 points}) = — 1. Each of the singular points 
ai, a2, as is one of the strata components Sq,^. , and thus x (G'\Saj, GX lower strata) = 1 in 
each of these cases. We have the isotropy subgroup at aj is 

„ _ „ _ / ^4 if j = 1 or 3 
Gj - Ga, - S Z2 if J = 2 



so that 



if j = 1 or 3 and p = Po 
X" {G/G.J , Cn,) = X' {G/G, )={ I if J = 2 and p = Po or p2 



otherwise 



Then Theorem 110.11 implies 

X'{M) 




which agrees with the previous direct calculation. 
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10.3. Transverse Signature Operator. In this section we give an example of a transverse 
signature operator that arises from an S^ action on a 5-manifold. This is essentially a modifi- 
cation of an example from p] pp. 84ff], and it illustrates the fact that the eta invariant term 
does not always vanish. Let Z'^ be a closed, oriented, 4-dimensional Riemannian manifold 
on which Zp {p prime > 2) acts by isometrics with isolated fixed points Xj, i = 1, ...,N. Let 
M = S^ Xi^ Z^, where Zp acts on S^ by rotation by multiples of — . Then 5*^ acts on M, and 
S^\M = 'Ijp\Z'^. Observe that this group action can be viewed as a Riemannian foliation 
by circles. 

Next, let D~^ denote the signature operator d + d* from self-dual to anti-self-dual forms on 
Z'^; this induces a transversally elliptic operator (also denoted by D^). Then the S'^-invariant 
index oi D^ satisfies 

ind"" (D+) = Sign {S\M) = Sign {Zp\Z^) . 

By the Invariant Index Theorem (Theorem 19. 6p . Remark 19. 4 [ and the fact that the Atiyah- 
Singer integrand is the Hirzebruch L-polynomial |pi, 

ind^« {D) = \ I pi 

1 ^ 

4s(-"(^r'i+"(^ri)- 

where each D- '''" is two copies of the boundary signature operator 

B = {-lf{*d-d*) 

on 2/-forms (/ = 0, 1) on the lens space S^/Zp. We have h (Dj^'^°) = 2h (B) = 2 (corre- 
sponding to constants), and in |0 the eta invariant is explicitly calculated to be 

„(z)r-)^2„(B)^-?|:cot(^)cot(^ 

where the action of the generator ( of Zp on S^ is 
with {mj,p) = {nj,p) = 1. Thus, 

s,gu (sNM) = i / ^ p. + i i: i: -' (^) -' (^) + ^ (i°-2) 

3 JZp\Zi P~[t^i \ P / \ P / 

Note that in ^^ pp. 84ff] it is shown that 

If 1 '" ^~' f] 

-3 JZp\Z'i P j^-^ ^^^ \ P J \ P 

which demonstrates that 

o / P^~o ^ Pi = ^> 

•J Jlp\Z* <J JZp\Z^ 



N p-1 



'' km i IT \ f krijii 
^ ' cot ' ^ 
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illustrating the difference in total curvature between the desingularization M and the original 

M. 

10.4. Basic index theorem for Riemannian foliations. The content of this section will 
be proved, generalized, and expanded in detail in [16j. Let M be an tt,- dimensional, closed, 
connected manifold, and let J-" be a codimension q foliation on M. Let Q denote the quotient 
bundle TM/TF over M. Such a foliation is called a Riemannian foliation if it is endowed 
with a metric on Q (called the transverse metric) that is holonomy-invariant; that is, the Lie 
derivative of that transverse metric with respect to every leafwise tangent vector is zero. The 
metric on Q can always be extended to a Riemannian metric on M; the extended metric 
restricted to the normal bundle NJ^ = {TJ^) agrees with the transverse metric via the 
isomorphism Q = NJ^. We refer the reader to [37j, [38], and [H] for introductions to the 
geometric and analytic properties of Riemannian foliations. 

Let M be the transverse orthonormal frame bundle of (M, J-"), and let p be the natural 
projection p : M ^ M. The Bott connection is a natural connection on Q that induces 
a connection on M (see [2Zl PP- 80ff] ). The manifold M is a principal 0(g)-bundle over 
M. Given x G M, let xg denote the well-defined right action oi g E G = 0{q) applied to 
X. Associated to J-" is the lifted foliation J-" on M; the distribution TJ-" is the horizontal 
lift of TJ^. By the resuhs of Molino (see [321 pp. 105-108, p. 147ff] ), the lifted fohation is 
transversally parallelizable (meaning that there exists a global basis of the normal bundle 
consisting of vector fields whose flows preserve J-'), and the closures of the leaves are fibers 
of a^ber bundle ^ : M — )■ W. The manifold W is smooth and is called the basic manifold. 
Let J-" denote the foliation of M by leaf closures of J-", which is shown by Molino to be a 
fiber bundle. The leaf closure space of (M, J^) is denoted W = M/J^ = W /G. 

p*E 
SO{q) 

E 

Endow {M,J-') with the transverse metric g'^ © g^^''\ where g^ is the pullback of metric 
on Q, and g'^^'^^ is the standard, normalized, biinvariant metric on the fibers. We require 
that vertical vectors are orthogonal to horizontal vectors. This transverse metric gives each 

of (M, J-') and (M, J-") the structure of a Riemannian foliation. The transverse metric on 
(M, J-") induces a well-defined Riemannian metric on W. The action of G = 0{q) on M 
induces an isometric action _on W. _ _ 

For each leaf closure L E J^ and x E L, the restricted map p : L — )■ L is a principal bundle 
with fiber isomorphic to a subgroup H^ C 0(g), which is the isotropy subgroup at the point 
7r(x) G W. The conjugacy class of this group is an invariant of the leaf closure L, and the 
strata of the group action on W correspond to the strata of the leaf closures of (M, J^). 

A basic form over a foliation is a global differential form that is locally the pullback of a 
form on the leaf space; more precisely, a E Q* (M) is basic if for any vector tangent to the 
foliation, the interior product with both a and da is zero. A basic vector field is a vector 
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field V whose flow preserves the foliation. In a Riemannian foliation, near any point it is 
possible to choose a local orthonormal frame of Q represented by basic vector fields. 

A vector bundle E — >■ (M, J-") that is foliated may be endowed with a basic connection 
V^ (one for which the associated curvature forms are basic - see ^26]). An example of such 
a bundle is the normal bundle Q. Given such a foliated bundle, a section s eT (E) is called 
a basic section if for every X G TJ^, V^s = 0. Let Tf, (E) denote the space of basic sections 
of E. Note that the basic sections of Q correspond to basic normal vector fields. 

An example of another foliated bundle over a component of a stratum Mj is the bundle 
defined as follows. Let E ^ M he any foliated vector bundle. Let Sq. = ^ {p~^ i^j)) be the 

corresponding stratum on the basic manifold W, and let W^ — ^ S„ be a canonical isotropy 
bundle (Definition 14. 9p . Consider the bundle tt*W'^ ® p*E — )■ p^^ {Mj), which is fohated 
and basic for the lifted foliation restricted to p~^ (Mj). This defines a new foliated bundle 
E'^ — )■ Mj by letting E^ be the space of O (g)-invariant sections of 7i*W'^ ®p*E restricted to 
p~^ (x). We call this bundle the l^^-twist of E — )■ Mj. 

Suppose that E \s a. foliated CI {Q) module with basic CI {Q) connection V'^ over a Rie- 
mannian foliation (M, T). Then it can be shown that Clifford multiplication by basic vector 
fields preserves F^ {E), and we have the operator 

Df : Lfc (E+) ^ r, {E-) 

defined for any local orthonormal frame {ei, ..., e,} for Q by 



D!=Y.^{ej)Vl 



^b(E) 



Then D^ can be shown to be well-defined and is called the basic Dirac operator corresponding 
to the foliated CI {Q) module E (see [22] )■ We note that this operator is not symmetric unless 
a zero**^ order term involving the mean curvature is added; see [2Z], |29], [30], [22], [10], [21], 
|16] for more information regarding essential self-adjointness of the modified operator and 
its spectrum. In the formulas below, any lower order terms that preserve the basic sections 
may be added without changing the index. 

Definition 10.5. The analytic basic index of D^ is 

indft (Df) = dimkerDf - dimker (Df)* . 

As we will show in [16j, these dimensions are finite, and it is possible to identify ind;, (-D|') 
with the invariant index of a first order, O (g)-equivariant differential operator D over a vector 
bundle over the basic manifold W . By applying the invariant index theorem (Theorem 19. 6p . 
we obtain the following formula for the index. In what follows, if U denotes an open subset 
of a stratum of (M, J-"), U' denotes the desingularization of U very similar to that in Section 
[71 and U denotes the fundamental domain of U inside U' . 

Theorem 10.6. (Basic Index Theorem for Riemannian foliations, in [TB]j Let Mq be the 
principal stratum of the Riemannian foliation {M,J^), and let Mi, ... , Mr denote all the 
components of all singular strata, corresponding to O (q) -isotropy types [Gi], ... ,[Gr] on the 
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basic manifold. With notation as in the discussion above, we have 
indfe(Df) = / _Ao,,(a;) |rf^ + V/3(M,) 

JMn/T 



i=i 



where the sum is over all components of singular strata and over all canonical isotropy 
bundles W^ , only a finite number of which yield nonzero A^^, and where 

(1) y4o,b (x) is the Atiyah-Singer integrand, the local supertrace of the ordinary heat kernel 
associated to the elliptic operator induced from D^ (a desingularization of D^ ) on 
the quotient Mq/J^, where the bundle E is replaced by the space of basic sections of 
over each leaf closure; 

(2) rj ( D- ^' j and h ( D- ^' j are defined in a similar way as in Theorem \9.^ using a 

decomposition Df = Dn * Dm at each singular stratum; 

(3) A'^-f^{x) is the local supertrace of the ordinary heat kernel associated to the elliptic 

operator induced from (l ® Dmj) (blown-up and doubled from 1 ® Dmj, the twist of 

Dm by the canonical isotropy bundle W^ ) on the quotient Mj/J^, where the bundle 
is replaced by the space of basic sections over each leaf closure; and 

(4) Hj. is the number of different inequivalent Gj-representation types present in a typical 
fiber of W . 

An example of this result is the generalization of the Gauss-Bonnet Theorem to the basic 
Euler characteristic. The basic forms Q (M, J-") are preserved by the exterior derivative, and 
the resulting cohomology is called basic cohomology H* {M,J^). It is known that the basic 
cohomology groups are finite-dimensional in the Riemannian foliation case. See [20], [30] , 
|28] . [29] . [2T] for facts about basic cohomology and Riemannian foliations. The basic Euler 
characteristic is defined to be 

We have two independent proofs of the following Basic Gauss-Bonnet Theorem; one proof 
uses the result in [8], and the other proof is a direct consequence of the basic index theorem 
stated above (proved in ^16j). 

In the theorem that follows, we express the basic Euler characteristic in terms of the 
ordinary Euler characteristic, which in turn can be expressed in terms of an integral of 
curvature. We extend the Euler characteristic notation x (X) for ^ ^iny open (noncompact 
without boundary) or closed (compact without boundary) manifold to mean 

Y (r) = ^ ^^^ ^^ ^ ^^ closed 

^^ ' X (1-point compactification of F) — 1 if y is open 

Also, if £ is a foliated line bundle over a Riemannian foliation (X, J-"), we define the basic 
Euler characteristic x {^i ^ ■, ^) as before, using the basic cohomology groups with coefficients 
in the line bundle C 

Theorem 10.7. (Basic Gauss-Bonnet Theorem, announced in [H], proved in [I6]^ Let 
{M,J^) be a Riemannian foliation. Let Mq,..., Mr be the strata of the Riemannian folia- 
tion {M,J^), and let Oj^jyy denote the orientation line bundle of the normal bundle to T 
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in Mj. Let Lj denote a representative leaf closure in Mj. With notation as above, the basic 
Euler characteristic satisfies 



X{M,7) = Y,X {M,/T) X {l,, T, Om,/T 



J 



Remark 10.8. In [221 Corollary 1], they show that in special cases the only term that 
appears is one corresponding to a most singular stratum. 

10.5. The orbifold index theorem. A smooth orbifold or V-manifold is locally diffeomor- 
phic to the orbit space of discrete group action on a Euclidean ball. Globally, such a space 
may always be rendered as the orbit space of a O (n) action on a smooth manifold, such 
that all of the isotropy groups are finite and the principal isotropy groups are trivial. The 
orbifold index theorem was proved in [32] , [S3] ; but we may now use Theorem 19.61 to express 
the index of an orbifold elliptic operator in a slightly different way, because the orbifold index 
corresponds to the invariant index of the induced transversally elliptic operator lifted to the 
O (n) action. The integrals over the quotients are integrals over the orbifold strata. Accord- 
ing to Theorem 19. 6[ the index of an orbifold elliptic operator D : F (M, E~^) — )■ F (M, E^) 
over a Riemannian orbifold M is 



ind(D) = / Ao(x) \dx\ +^/3(S,) , 

^ (^'> = i ^ ^^^^ (-" (^r') + " («r')) /^ -4,. (.) m . 

beB " ''^1 

where Mq is the principal stratum of the orbifold (manifold points) after equivariantly desin- 
gularizing along all singular strata and taking the quotient, and each Ej is the orbit space 
of the fundamental domain of a component of the singular stratum Sj of the orbifold after 
desingularizing Sj along all singular strata properly contained in the closure of Sj. Also, 
Aq [x) is the Atiyah-Singer integrand for the operator D, and Ajf, (x) is the corresponding 
Atiyah-Singer integrand on the stratum Sj, where the restricted operator is modified by 
twisting by the canonical isotropy bundle W^ of the isotropy subgroup of O (n). The op- 
erators D- "*"' on the sphere fibers are defined as in the rest of the paper and in Theorem 

[m 

On the other hand, the orbifold index theorem in [33] states that 



ind(D) = / Aq{x) \dx\ 

J Mo 

+ V— / A^{x) \dx\, 
. ^i Jm, 



H J Mi 

where Aq (x) is the Atiyah-Singer integrand for the operator D, and Ai (x) is the corre- 
sponding Atiyah-Singer integrand on the set Mj. The set Mj is a connected component of 
the blown- up singular set EM of the orbifold: if a neighborhood of x is isometric to U^/Gx^ 
with Gx < O in) being the isotropy, 

EM = {(x, {hx)) : X G M, {hx) is a nontrivial conjugacy class in Gx} ■ 
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The centralizer Zq^ {h) of h E G^ is not effective on Ux] the order of the trivially acting 
subgroup of Zg^ {h) the integer ^(j. (/i^)). This integer is constant on the connected compo- 
nents Mi of SM, so that one may write rrii = m(^x,{h^)) for any (x, {hx)) G Mj. Clearly, the 
Kawasaki result is a different formula than that resulting from our theorem, mainly because 
in our case the singular strata are blown up. We note that in [32], a very similar formula to 
(110. 2p above is provided for the orbifold signature theorem. 



11. Appendix: Generalized spherical harmonics 

Collected here are the necessary facts concerning eigenvalues of spherical operators arising 
from writing constant coefficient, ffist order differential operators in polar coordinates. 

11.1. Polar coordinate form of constant coefficient operator on M*^. We consider the 
following situation. Let Qi : C°° (M'', C^) — )■ C°° (R'', C^) be an elliptic, ffist order, constant 
coefficient differential operator on M'^ with k > 2. Let 

k 

where by assumption Aj G GL{d,C), and for any c = (ci,...,Cfc) G M'^, det (^CjAj) = 
implies c = 0. Note that 

We form the symmetric operator Q : C^ (M^ C^ © C^) -^ C°° (R^, C^ © C^) 



^\ A. 

We write Q in polar coordinates (r, 9) G (0, oo) x S''^^, with x = r9 = r {9i, ..., 9k), as 
Qi = Z+ (9^ + -Q^+J , sothat 



Q 



where 



{dr + }.Q'+yz- 

Z (dr + -Q' 

\ r 



k 
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and 



Q^+ 



(r,9) 



j=i i=i 

k 



j = l ^ j/ 7 = 1 V 



r do. 



d 



0=1 / i=i ^ i=i "^"^ 






^M) = (^")"E^. ^ 






i=i 



i=i 



'a^, 



9^,- 



:ii.i: 



Note that ^ and Q"^"^ niay be regarded as an operator on the sphere, and the matrix Z is 
independent of the radial parameter r. Thus the adjoint of Z is also independent of r. Since 
Q^~^ does not differentiate in the r direction, the formal adjoint of Q^~^ restricted to the 
sphere is the same as the formal adjoint of Q'^^ as an operator on M^, restricted to functions 
that are locally constant in the radial directions. Note that the formula above implies that 
if -u is a constant vector in C^, then Q^^u = 0. Because the formal adjoint of dr is —dr — ^^^ 
on M.^ and by the properties indicated above, we have 



dr + -Q- 

r 



Thus, we have that 



7-\-^- 



-dr - AA + g^+* 0-\Z+* 



-Z+* dr + 



U + :L_1 _ (z+*) -1 qs+* ^z+*) o-\. 



z- 

Z+ 



Q' 



with 



'+* r^s 



Q' 



g^+ 
Q^- 



{k-i)i-r{z-) 'g^+*(z-)o-. 



Note that by the choice of polar coordinates, Q^ is an operator on the sphere and does not 
differentiate in the radial direction, so that 



-\-i nS+* 



{k-l)I-r {Z-y Q^+* {Z-) o - 



Q'-{r{Z-)-' 

rg^-(Z-)"' = r{k-l){Z-y'-r{Z-y'Q''+*. 
Multiplying on the left by -Z~^ and solving for Q'^~^*, we obtain 

g^+* = (A; - 1) / - Z'Q^^ [Z^y^ , or 

g^- = (k ~ I) I - {Z-y' Q'^^* {Z-) . 



(r-iz-r), 



or 
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In summary, our operator Q : C^ (M'=, C^ © C^) -^ C^ (M'^, C^ © C^) satisfies 

g ^ E ( ;^. "o^^* ) a, (11.2) 



z^5. + -g^j = ^^, Jl^^ + rV g- 

-z+* W;. , 1 /^ Q^'^ 

^+ yv^V (A;-i)/-(z+*)"'g^+*(z+*: 

-Z-* i r^' + r V g^- 



and 



Q^* = {k-\)I-ZQ^Z-^ (11.3) 

In the case of a Dirac type operator, Q^ restricts to a Dirac-type operator on the sphere 
that does not inherit the grading. 
Note also that 



k , fc 



If we assume that Z^ is an isometry, then 
Then 



i=i i=i 



-1 I '^ 



r 



fe k k k 

-1 



^M) = ^ E (^^) ^^-^^^ - E "^^^^ = E ^^^^^^-^^^ - E ^^-^^ ' 

so that g'^+ fixes the vector space of polynomials in x that are homogeneous of degree m, 
for m > 0. A similar fact is true for {Q^^^ ■ In the following section, it will be shown that 
in fact {Q^"^) = Q^^ on appropriate subspaces of sections. For future reference, note that 
Q^'^ is a continuous function of the matrices Aj. 

11.2. Eigenvalues of Q'^^ . Let 

= (-dr-'^ + l (Q'^T) {Z^Y Z+ U + Iq'A , and 

\ r r J \ r J 

if we let Z~^ be an isometry. Let 

which is, up to a sign, the principal symbol of A. Let Vm denote the vector space of 
polynomials in x that are homogeneous of degree m with coefficients that are d-dimensional 
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complex vectors. We define the following Hermitian inner product ( ■ , ■ ) on Vm- Given 
any P,Qe Vm, we write 

p{x) = j2 Pc.x''^ Qi^) = Yl ^"^" 

where a = {ai, ...,0;^) is a multiindex and x" = Xi^X2^ ...x'^'' . We define 
where a\ = ai\...akl- Observe that 



{P,Q) = P{d)-Q{x) 



where P (d) means ^ P°'da, and where P (d) ■ Q (x) means ^ alP"" ■ Q^daX^ . Observe that 
( ■ , ■ ) is a positive definite Hermitian inner product on Vm- 

Proposition 11.1. Form > 2, the linear map A : Vm -^ Vm-2 is onto. Also, letting 

Tim = ker A fl Vm = ker Qi fl Vm, 

the space Vm is the orthogonal direct sum 

[m/2\ 

^m= iB{x)fnm-2r 

j=0 

Proof. Observe that for every Q G Vm-2 and every P G Vm, 



{Q,AP) = Q (d) ■ B (d) P (x) 



a,P,«J 



J2 «! {-A*AQa) ■ Ppd^ {d,d,x^) 



a,P,i,J 



= iBQ)id)-Pix) = {BQ,P). 

If Q e Vm-2 is orthogonal to A (Vm), then the computation above implies that every P G Vm 
is orthogonal to BQ G Vm, so BQ = and thus Q = 0. (Here we use the fact that Qi and 
thus A is elliptic.) Thus A : Vm -^ Vm-2 is onto. Also, AP = if and only if {BQ., P) = 
for every Q G Vm-2, so Vm = Hm ® B (x) Vm-2- The result follows. D 

J . The 

dimension km of the space Tim is 

Next, let 



CLjYi 


- dm-2 ifm>2 


CLjYi 


zfm = 0,1 


J 





«=( Q, 0' l = >,l . r.' la 



J 



as above, so that 



Q' 



A J} 

(Z+)A(Z+r^ 
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with ^ 

A= {Z+y'Q,QlZ+. 

Writing Q in polar form 

Q = z(dr + ^Q^j , 
note that a polynomial pm of degree m is in the kernel "Hm = ker A implies 

(-dr -^^ + - [Q'^y] (dr + -Q'A Pm = 0, Or 

\ r r J \ r J 

f-Ull^^ + 1 (qS+y) (a^ + IqsA p^ = 0, so that 
\ r r J \r r J 

{- {m + k - 2) + [Q'+Y) [m + Q'+) Pm = 0. (11.6) 

Since the vector space T-Lm of polynomials that are homogeneous of degree m in ker A is finite- 
dimensional and is fixed by Q^^ and {Q^^^ , the following linear algebra fact is relevant 
(thanks to George Gilbert and Igor Prokhorenkov) : 

Lemma 11.3. Suppose that L is an r x r complex matrix that satisfies 

{L - al) {L* - bl) = 0, 

where L* is the adjoint (which is the conjugate transpose), a, 6 G M, and I is the identity 
matrix. Then L is Hermitian, and each eigenvalue is a or b. 

Proof, li a = b, then L = al, since if M is an r x r matrix with MM* = 0, then M = 0. 
If a 7^ 6, then by taking adjoints we also have that (L — bl) {L* — al) = 0. Subtracting the 
two equations, we obtain 

{a-b)L + {b-a)L* = 0, 

so that L = L* and is thus Hermitian, and since its minimal polynomial is a factor of 
(x — a) {x — b), the result follows. D 

Proposition 11.4. For any m G Z>o the restriction "H^ ofHm = Vm H ker A to the unit 
sphere S''~^ C M*"' is the L"^ -orthogonal direct sum of the eigenspaces of Q^^ corresponding 
to eigenvalues —m and m + k — 2. 

Proof. Lemma 111.31 and Formula 111.61 D 

Observe that do = dimPg = dimT^o = ho = d, and di = dim Pi = dim "Hi = hi = dk. 
Letting Ex denote the eigenspace of Q^^ corresponding to eigenvalue A, by formula Oll.ip 
we have 

d = dim Eq + dim Ek-2 > d + dim Ek-2, so 

dimii^o = d; dim_Efc_2 = 0. 

Note that we do have similar facts for ker A, because also maps Vm to Vm-2- If Pm £ 
Vm n ker A, we have 

Apm = (dr + -Q'A(-dr-^^ + -{Q'^Y]pm 

\ ^ J \ '^ r ^ J 

fm — 1 l^Q+A f m + k — l 1 /„04-\*\ 
\ r r J \ r r J 
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which imphes 

(^ _ 1 + qs+) (_ (^ + fc _ 1) + (g^+)*) p^ = 0. 

Then, Lemma 111.31 imphes the foUowing. 

Proposition 11.5. For any m G Z>o the restriction T-L^ of Vm HkerA to the unit sphere 
S^^^ C TV' is the L"^ -orthogonal direct sum of the eigenspaces of Q^'^ corresponding to 
eigenvalues —m + 1 and m + k — 1. 

Proposition 11.6. Let V^ denote the restriction ofVm to the unit sphere S^~^ C iV' , and 
lefH^ he defined similarly. Let Ex denote the eigenspace ofQ^^ corresponding to eigenvalue 
A. Then 

-pS njS I njS I I njS 

' m ~ i^m "T i^m-2 "I" •■■ "•" i^m-2\m/2\ 

= E_m + ••• + Eq + -Efc-i + ... + Em+k-2- 

That is, V^ has a basis consisting of elements of kei A, restricted to S*^^^. Similarly, letting 
H^ denote the restriction ofVm HkerA to S^~^ , we have that 

T>S njS I qjS I I qjS 

' m ~ '^m "T '^m-2 ~r ■■■ -T '^rn-2\m/2\ 

= -E'-m+l + •■• + -^0 + -E'fc-1 + ••• + Em+k-1- 

In particular, we have that for all m > 0, 

dim E_m = dim E,^+k-i 
Proof. Clearly 1-1^-2] ^ ^m ^^ < j < [m/2j, since |a;| -' 'Hm-2j C Vm- Also, the subspaces 
^m'^m-2; •••;^m-2|m/2| ^^^ linearly independent. Otherwise, a nontrivial polynomial in 
kerA would be identically zero on S^~^. By Proposition lll.4i we could write this vector- 
valued polynomial as a sum of eigenvectors of Q^~^ and thus each eigenvector would have to 
be zero. Since eigenvalues of Q^~^ corresponding to distinct m e Z>o are distinct, each such 
eigenvector is written as a vector of polynomials of pure degree that is identically zero on 
the sphere. Because any such polynomial is the zero polynomial, this implies that there is 
no nontrivial polynomial in ker A that is identically zero. Further, By counting dimensions, 
the result follows. The second part of the corollary is proved in a similar way. D 

The denseness of polynomials in L^ (5^^^^) and the formulas above imply the following 
result. 

Proposition 11.7. The spectrum of Q^^ is discrete, and there is a basis of L"^ [^S^^^,C'^) 
consisting of eigenvectors of Q''^'^ . The set of eigenvalues of Q^^ is a subset of Q = 
{..., —5, —4, —3, —2, —1, 0,k — 1, k, ...}. Let Hj denote the multiplicity of the eigenvalue j G 
Q. Then the nonnegative integers Hj satisfy the equations 

jjiQ = d , jji_j + /ifc_2+j = hj , and 
j 
H-j = /ij+jfc-l = 2_^ (~1) ^m = dj ~ dj-i 

m=0 

= rfr ^^~ J for all J >0. 

Remark 11.8. Observe that this gives a universal formula for the eigenvalues of any such 
Q^^ that depends only on the rank d and the dimension k. 
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11.3. The equivariant case. Suppose that we have the setup as in Section [11.11 and 111. 2[ 
but that in addition we are given a subgroup H oi O {k) that acts on M^ in the obvious way 
and also acts unitarily on each summand of C^ffiC^, such that the operator Qi (and thus Q) 
commutes with the if-action. Then, given an irreducible representation a : H ^ GL{V), 
we consider the restriction of each of the operators in the sections above to the space of 
vector- valued functions of type a. Then the following generalizations of Propositions lll.4[ 
lll.5[ lll.6[ and 111.71 are immediate. 

Let the superscript a denote the restriction to the space of vector- valued functions of type 
a. 

Let d'^ denote the dimension of {VmY = V^. As before, the dimension h'^ of the space 
"^m = ^m n (ker A)"* is then 

/,« ^ / C - dm-2 if "^ > 2 
*" \ dZ, if m = l,2 

Proposition 11.9. For any m G Z>o the restriction 'H^'^ ofH^ = Pmn(ker A)" to the unit 
sphere S''^^ C TZ^ is the L'^- orthogonal direct sum of the eigenspaces of Q^^'" corresponding 
to eigenvalues —m and m + k ~ 2. 

Proposition 11.10. For any m E Z>o the restriction Hnf of Vm H (ker A] to the unit 

sphere S**^"^ C TZ'' is the L"^ -orthogonal direct sum of the eigenspaces of Q^^'"' corresponding 
to eigenvalues —m + 1 and m + k — 1. 

Proposition 11.11. Let P^'" denote the restriction of V^ to the unit sphere S^^^ C TV', 
and let H^" be defined similarly. Let E'^ denote the eigenspace of Q^^'°' corresponding to 
eigenvalue A. Then 

' m ~ i^m "T 'l-m-2 "r ••• "r '^m-2[m/2\ 

- E_rn + ■■■+ ^0 + ^k-l + ■■■+ J^m+k-2- 

That is, V^" has a basis consisting of elements o/(kerA)", restricted to S''^^. Similarly, 
letting T-Lnf denote the restriction ofVm H (ker A j to S'^^^, we have that 

'r)S,a njS,a . njS,a . . n/S,a 

' m — i^rn "t" rLrn-2 "r ••■ "r '^m-2\m/2\ 

In particular, we have that for all m > 0, 

dimE^^ = dim£;^+fc_i 

Proposition 11.12. The spectrum ofQ^^'^ is discrete, and there is a basis of L"^ {S''^^, C^) 
consisting of eigenvectors of Q^^'°' . The set of eigenvalues of Q^~^'°' is a subset of Q = 
{..., —5, —4, —3, —2, —1, 0, A; — 1, k, ...}. Let /i" denote the (possibly zero) multiplicity of the 
eigenvalue j G Q. Then the nonnegative integers /i" satisfy the equations 

fi^ = dimC^'" , /i^,+/i^_2+, =/i° , and 



z^-. 


+f^t- 


■2+i - 


-h- 


!.(- 


-ly^" 


"'m 


= d- 



m=0 
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Remark 11.13. Observe that this gives a universal formula for the eigenvalues of any such 
QS+,a ^]-^g^^ depends only on the irreducible representation a and the actions of H on M'^ and 
on C^. Furthermore, since Q^~^'°' varies continuously with the entries of the matrices Aj, 
we note that any continuous function of the set of eigenvalues (such as the eta invariant or 
the dimension of an eigenspace) remains constant as the matrices Aj vary continuously (and 
equivariantly) . Furthermore, any spectral function of the form 

AeCT(QS'+.") 

such as the trace of the heat kernel or the zeta or eta functions, is invariant under equivariant 
stable homotopies of the original operator Q. 
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